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PREFACE 


Tkt  Mwnmtinity  |i  prescntlf  golttg  tluough  fc  tt^ot  tf«nrfonn*tlott  broofht 

•bout  by  the  minUtarisatkm  of  computer  lyitemi.  One  of  tbe  Important  Mpecte  of  tbii 
transformation  b  that  most  of  thew  systems  deal  directly  with  knowledge  •  ftwn  data 
maidpulatlon  to  specifying  recommendations.  Expert  Systems,  n  tuccessful  by-product  of 
Artifidal  huteOigence,  art  good  examples  of  these  knowledge  handling  toob.  Afford^ta 
hardware  and  software  make  Expert  System  technology  easny  aecessibb  to  the  most  remote 

users  of  expertise.  The  fact  that  operative  knowledge  can  now  be  transported  onto  dfakettes 

and  updated  on-sIte  brings  a  renewed  flexibility  to  various  domdns  of  endearing.  The 
«yMt%nt  drain  of  corporate  memory  and  knowledge  imposed  by  postings  and  transfers  In 

DND  could  be  ndnlmbed  by  capturing  and  storing  experUse  In  these  systems. 

The  first  Symposium/Workshop  on  the  Applications  of  Expert  Systems  in  J)ND  was 
held  in  Match  1989  at  EMC  and  many  of  the  participants  expressed  the  desire  to  hold 
tegular,  meetings  In  the  future.  Since  then,  a  Sjrmposlum/Workshop  has  been 

organised  each  year. 

As  for  the  ptevhras  Symposium/Workshops,  tha  one  b  organised  with  the  lnt«it  to 
create  a  vehicle,  within  the  Department  of  National  Defence,  to  promote,  stimulate  ^d 
demystify  the  development  of  Expert  Systems  and  their  applications  to  en^eeriny  ‘  Ifhe 
materia!  and  bLormatloa  wntained  in  the  papers  are  pubibhed  In  the  exact  fiarm  as'^ven 
by  the  authors.  Any  statement,  opinion  or  view  expressed.  In  the  papers  are  the  sob 
responsibility  of  the  authmu.  Mention  of  trade  names  or  commercial  products  does  not 
endorsement  or  recommendation  for  use, . 

We  would  like  to  express  our  sincere  ^>preclatim  to  the  authors  for  thdr  coatribution 
and  cooperatimi  In  the  production  of  these  proceedings.  We  are  grateful  to  the  staff  of  the 
Royal  Military  CoUqp  of  Canada  for  thdr  support  In  orgaidslng  thb  meeting. 
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b  pven  to  the  author(s)  and  that  reference  b  made  to  these  Proceedings. 
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DEVISINO  A  BATTLE  PLAN  WITH  CASE-BASED  REASOISiflQ 

JamfisBowan* 

Abstract 

Whan  devtebHJ  sirategks  and  tactual  plans  an  Imported  aspect  to  consider 
Is  the  response  trf  the  opposint}  force  ior  tfie  bnplsrmntation  of  the  plans.  H  a 
eomputerteed  system  couW  be  build  whteh  wmikJ  anticipate  opposing  force  reaction 
to  oftensive  movements  t  could  result  in  discoverittg  weaknesses  In  strategic  and 
tactical  plans.  This  system  would  need  to  take  into  account  many  differwt  pieces 
ef  information  In  oitter  to  determine  possible  c^^poslng  force  response  tactics. 

One  such  method  of  generating  possfole  responses  must  first  det®mfoe 
If  the  opposfog  force  cwnmanders  team  by  examining  previous  military  situations. 
This  method  of  reasoning  was  (foserved  In  foe  recent  war  when  defense  strategies 

used  resembled  those  of  WW I.  ^  , 

H  so  then  a  method  calted  case-based  reaswiing  might  provide  foe  basis 
for  such  a  cwnputerteed  system.  This  system  could  combine  timltations  knf»sed 
by  the  environmert,  eg.  personnel,  orders,  equipment,  etc.,  with  previous  military 
tttuations  to  suggest  responses  to  planned  offense  movements.  This  paper 
rSseueses  the  ai^xopriate  mllitaiy  situation,  case-based  reasonfog,  iwevlous 
eppiteations.  a  mBitary  exan^.  Bmitations,  the  research  issues,  wxl  a  brief 
comparison  to  rules  end  neural  nets.  Finally,  •  case-based  reasoning  system 
could  be  foe  beginnfog  of  atrue  teamfof  machine  which  would  continually  focrease 
Us  understanding  of  cv)posing  forces. 


lilt  -  Suii*  300. 19  FifeiawTAT*..  Ooawt,  Oalario.  KlY  1X4  (613)722-3008 


1 


MILITARY  REASONING 


In  imnl.  a  military  commander's  strategk  and  tactical  tesponae  to  events 
fenoated  by  the  o(qposin|  force  is  foided  by  six  con^derations:  direct  orders,  military 
ptdic)  (e.|.  cnldelines.  continfency  plans,  etc.),  Intellijcnce/infoiraation, 
experience/training.  imitations  tit  eqoipment/!resoarcesAetiain/peisonnel/etc.,  and 
analysis  of  previous  military  situations.  As  a  case  in  point,  Iraq's  strategical  and  tactical 
manoeuWes  wiUi  Iran  and  later  tviUi  coalition  forces  were  reminisced  of  WW I  defense 
Sttaregi«(.In  addition,  cmdition  ground  strategies  were  reminiscent  of  the  Korea  war  and 

wwn. 

At  the  b*wi<.«^w  level,  in  totalitian  regimes  such  as  commimist  states  (USSR  ?) 
or  tictatorships  (Iraq)  there  is  little  room  for  creative  or  free  ddnking  tm  the  part  of  the 
commander.  If  faced  with  a  situation  outside  the  direct  orden  or  known  policy,  response 
might  be  determined  by  using  solutions  proved  successfully  in  similar  previous 

situations.  This  also  allows  die  commander  to  justify  action  taken  at  a  later  date. 

If  a  system  could  be  designed  which  would  inewporate  known  military  policy, 
restraints  on  equipment,  resource,  terrain,  personnel,  etc.,  as  well  as,  previous  military 
situations  it  could  have  potential  in  determining  response  to  offensive  movements.  This 
could  be  done  b>  determining  a  profile  of  the  capabilities  of  dm  opposing  side  and  its 
studied  or  experienced  military  situations.  Each  previous  military  situation  could  be 
compared  to  antierpt^red  offensive  movements  and  the  closest  match  may  indicate 
opposing  force  response.  Such  a  system  could  indicate  •  weakness  in  offensive 
movements. 

In  the  case  "freer”  nations  a  wider  definition  of  "closest  match"  could  be 


used. 


In  addition,  such  a  system  could  incorporate  the  individual  profile  of  a  Canadian 

Commander’s  experience  to  produce  I  sys^m  to  probe  for  weaknesses  in  their  thinking. 
If  property  designed  it  could  be  used  in  a  war  games  approach.  Where  the  system  reacts 
to  die  user’s  movements  according  its  rote  as  the  opposing  force. 

Recently,  a  need  has  been  expressed  for  computer  support  in  devising  plans  for 
a  tactical  and  missioa  oriented  pilot’s  associate;  autonomous  land  vehicles;  naval  battle 
management;  and.  the  air  land  battle  coireept  of  NATO  [1]  [2].  This  paper  is  designed  to 
^ve  an  overview  of  a  technology,  which  may  be  ^ipropriaie  for  such  systems,  called 
case-based  reasoning. 


CAS&BASED  REASONING 

Artificial  Intelligence  (AI)  encompasses  many  different  areas  such  as  natural 
language  processing,  robotics,  etc  [3].  One  area  is  machine  learning  (although  some 
argue  it  Is  not  a  part  of  AI).  In  machine  learning  there  are  4  main  subareas;  Induction 
Oeaming  a  general  concept  from  viewing  both  positive  and  negative  examples),  analytic 
(deductive  approaches  using  past  experiences  to  provide  examples  and  guide  the  solution 
for  a  new  problem,  (or  example,  case-based,  analogical,  explanation  based  learning), 
genetic  algorithms  (produce  mutations  of  examples  by  selecting  the  best  features  of  a 
class  and  use  a  selection  process  to  achieve  objective)  and  connectionism  or  neural  nets. 

Before  discussing  Case-based  teaming  its  worth  white  to  discuss  a  few  points 
about  teaming  in  general,  first  some  definitions  [4]: 

, 

1  ■  ' 

1)  Analogy  which  infers  resemblance  between  two  objects.  For  example, 
class  attributes  of  a  first  case  are  listed  and  a  second  case  is  compared  to 
see  if  it  is  a  member  of  the  same  class  of  cases; 

2)  Generalization  may  occur  when  two  or  more  cases  share  two 
characteristics  and  where  a  class  of  additional  cases  share  one  of  the 


3 


characteristics.  In  the  gemralization  process  the  second  characteristic  is 
inferred  as  an  attribute  of  the  additional  cases  as  well 
3)  Cause  and''.'  ct  connections  can  be  inferred  between  events  or 
attributes  which 'V’pear  to  occur  together  for  cause  and  effect  analysis. 

■■  l;  4" 

b  general.  leaniing  af^roaches  may  requite  the  following  idrilities  [4]: 

1)  The  ability  to  mason  with  cases  and  examples  duough  analogy: 

2)  Handte  ill-defined,  qpen  textured  {xoblems  i.e.  to  prove  an  argue 
duough  a  logical  analysis  of  subjective  information  with  little  or  no 
predefining  parameters; 

3)  Handle  fimdamental  conflicts  between  previously  generated  rales  and 
newly  generat^l  rales; 

4)  Handle  change  and  oon-monotonoci^,  udiidi  is  defined  as  the  constant 
change  in  the  fHoposed  rules  as  die  underlying  cases  change. 

If  a  computerized  learning  system  was  built  it  would  have  [4]: 

1)  bdexing  abilities  b  order  to  search  for  relevant  {nevious  cases; 

2)  Assessment  abilities  of  sdmUarities  and  differences  between  the  current 
case  and  ptevknis  ones; 

3)  The  abili^  to  generalize  b  Oder  to  evaluate  potential  solutions; 

4)  The  abili^  to  adrqit  to  changbg  underlying  facts. 

Case  based  reasonbg  (CBR)  has  received  amne  attertdrm  lately  as  tbeimtic 
concepts  are  now  bebg  af^lied  to  real  problems  [S]  [4].  This  Qrpe  of  reasoning  got  its 
start  with  die  tteory  (rfDyruunic  Memory  Structures  [6]  [7].  Case-based  reasoning  can  be 
defined  as  the  ability  to  match  the  facts  of  a  situation  against  previous  ones  and  adapt  the 
stdution  to  the  new  case.  The  central  idea  behbd  CBR  is  that  reasonbg  is  done  from 
previous  cases  and  not  from  "first  principles",  le.  conclu^ons  are  drawn  from  the 
available  case.  This  allows  a  problem  solving  and  reasonbg  system  to  avoid  known 
errors  and  teach  a  solution  b  a  mom  guided  way.  Le.  incorporating  the  solution 
methodologies  found  successful  in  previous  cases.  The  ba«c  method  is  to  first  select  a 


case(s)  which  best  matches  the  corrent  situation.  Next,  these  cases  are  slightly  changed  or 
even  dastically  modified  in  order  to  mote  closely  match  and  solve  the  current  case.  If 

the  solution  is  correct  the  new  case  may  be  added  to  the  knowledge  base. 


PREVIOUS  CASE-BASED  REASONING  SYSmiS 

Now,  wifli  an  idea  of  general  learning  concepts  and  what  case-based  reasoning 
is.  the  following  section  examines  previous  computerized  uses  of  it  This  teaming^ 
approach  has  been  used  in  a  variety  of  areas.  For  example.  Chess  has  been  a  popular 
Implication  area  (8]  191,  under«anding  human  intentions  in  miUtary  aiuarions  [lOJ, 
accomplishing  Natural  Language  processing  CHJ*  Some  authors  have  suggested  a 
piantwH-  that  would  retrieve  and  modity  past  experiences  as  guides  to  solving  ikw  cases. 

Their  w<^  was  concerned  with  adversarial  planning. 

ARIES  [12]  used  a  certain  type  of  memory  for  the  storage  of  cases  and  a  partial 
m«trhAr  with  a  built-in  criterion  and  an  indexing  mechanism  for  case  retrieval.  The 
retrieved  case  was  changed  heuristically  until  it  satisfied  the  requirements  of  the  current 
problem.  Because  of  the  obvious  problems  of  such  a  retrieval  strategy  (ARIES  cannot 
conrider  alternatives  or  retrieve  sibproblems,  instead  of  whole  problems,  from  memory). 
The  author  presented  a  new  methodology  and  a  novel  definition  of  when  two  cases  are 
"similar":  two  problems  are  amilar  if  their  initial  analysis  yields  die  sanne  reasoning 
steps,  ix.,  Aey  consider  the  same  issues  and  make  the  same  decisions  [13].  Furthermore, 
by  storing  alternatives,  failed  solutions  and  reasons,  the  system  is  capable  of  better 
utilizing  its  previous  experiences. 

MEDIATOR  is  a  case-based  system  that  stores  its  cases  as  generalized  episodes 
[14]  [?5].  MEDIATOR  uses  an  a  priori  evaluation  of  the  closeness  of  fit  of  a  plan  in 
memory  to  the  current  case  for  old  plan  selection.  Indexing  is  furthermore  enhanced  by 
the  features  that  describe  possible  plan  failures. 


WOK  f  161  and  CHEF  1 17J  U8] «« caa-based  planning  programs  that  work 
in  Uk  domain  of  cooking.  WOK  generates  plans  by  retrieving  an  old  one  from  memory 
and  modifying  them  to  fit  the  correot  probknn.  WOK  is  tmkiae  in  Its  letrieval  medtod, 
since  it  uses  sobgoal  intenctioas  as  todexing  mechanism.  CHEF  retrieves  plans 
•cttoiding  to  die  number  goals  dtey  »Jisfy  and  the  interaction  of  goals,  and  then 
modifies  dtem  to  satisfy  unsatisfied  goals. 

PLEXUS  is  a  plannm'  applied  to  common-sens:  leasming  11$].  PLEXUS 
retrieves  old  plans  by  use  of  *e  background  knov/lcdge  of  a  plan  that  includes  gereral 
plans,  categorisation  and  causal  knowledge. 

Rnally,  TOLTEC  is  a  care-based  planning  system  that  l»s  been  applied  to 
maiiufactming  problems  [20]. 

The  domain  of  appUcation  of  CBR  systems  is  constantly  b^  expanded.  New 
lystems  are  attempting  to  apply  CBR  in  legal  reasoning.  batUefieid  inanagc.Tient,  medical 
diagnosis,  manufacturing,  and  »  forth.  CBR  is  viewed  by  many  as  the  new 
methodology  for  Intelligent  systems,  which  will  eventually  replace  fl«  cmrent  rale-based 
formalisms  for  certain  types  of  problems. 


SAMPLE  MILITARY  CBR 

The  following  very  ^p!e  example  suggests  ore  of  many  possible  ^iproaches 
that  could  be  looked  at  in  a  mliitaiy  CBR  study.  In  order  to  construct  such  a  system  liic 

following  methodology  might  be  used: 

1)  Identify  the  features  in  each  previous  military  situation/case.  Assuming  each 
care  contains  both  information  of  general  content  and  technical  expertise.  The  technical 
expertise  might  be  extracted  by;  a)  Identifying  key  words,  phares  or  combinations  of 
letters  which  represent  the  possible  inputs.  This  could  com  weapons,  geographic, 
tactics,  strategic  intent,  etc.  b)  In  toe  situation  where  a  tactic  can  be  linked  in  a  hierarchy. 


Tlie  next  step  b  to  identify  second  kvel  or  as  many  Jevels  as  necessary  of  icsulung 
tactics.  TWs  could  occur  where  there  Is  more  than  one  tactical  goal.  0  EsiaWish 
lelationships  between  the  features,  establish  strength  and  direction  ot  relationship.  i.e. 
causality.  F«r  example,  troop  and  wer^wns  movements,  d)  Idottify  results  or  causes  of 
fettutes  and  establish  relation  between  features  and  results/causes.  For  example,  troop 
movemenu  may  precede  road  and  radar  upgrades  or  aggressive  political  statements,  e) 
Identify  and  establish  lelationships  between  lesults  and  successful  counter 
offense/defcose.  FOr  example,  stttic  defense  lines  may  be  bypassablc.  0  Ibb  tystem 
would  have  to  be  able  to  distinguish  and  deal  with  commonly  accepted  words  such  as 

•airborne"  and  variable  standard  words  such  as  adjectives  lilm  •massive*. 

2)  A  software  tool  to  manslate  cases  into  structured  representation,  the  features, 
the  military  situation  and  possible  responses  must  be  linked.  This  lelationship  would 
ctmtain  three  values:  the  link,  causality,  degree  of  strength.  The  main  result  would  be 
the  ability  to  link  each  feature  with  its  defensive  manoeuvre  and  give  a  certainty  value. 

3)  Once  operational,  a  machine  teaming  system  would  accumulate  new  roles 
from  new  cases.  This  system  would  have  to  address  the  issue  that  new  cases  might  cither 
change  the  relationship  derived  earlier  or  extract  new  relationships.  This  system  would 
have  to  be  able  to  handle  conflicts  generated  by  new  cases.  For  example,  in  the  situation 
where  several  tactical  defensive  solutions  are  acceptable  given  Urn  same  offense  tactics. 

4)  The  resulting  symptom  would  then  be  able  to  recognize  the  key  features  of  a 
new  case,  match  them  against  previous  cases  and  derive  a  listing  of  probable  causes. 
Since  each  feature  has  a  degree  cS  strengtii  associated  with  it  and  a  cause,  die  system 
could  compute,  using  an  appropriate  certainty  or  probabiUty  scheme,  which  caose(s)  are 
most  probable.  At  this  point,  the  same  kind  of  procedure  could  compute  the  listing  of 

most  probable  defensive  tactic. 


primacy  OF  RECENT  DATA 

Tte  foUowinj  two  sections  discuss  heuristics  for  derigninf  such  systw^ 

One  important  point  that  has  been  kivned  is:  recent  datt  would  always  take 
precedence  over  older  data  pij. 

The  best  way  to  make  certain  tiie  most  recent  data  to  fire  lystem  talres 
precedence  over  old  date  is  to  run  cases  from  the  dau  base  tfuough  tiie  teaming  system  in 
chronological  order  (when  tnining  the  system).  This  would  be.  necessary  as 
advancements  in  military  technology  continually  ahows  more  options.  Using  this  form  of 
the  algorithm,  tbe  system  docs  not  need  to  search  the  dau  base,  histead.  If  the  system 
its  own  rules  derived  from  cases  then  for  each  new  case,  it  searches  its  own 
rote  base  until  it  finds  the  rote  that  best  matches  the  case.  The  rule  it  finds  might  be  based 

30  a  aingte  case  or  could  be  a  generalization  from  many  cases.  Then  the  ^stem  needs  to 

check  the  conclusion  of  the  rote  and  compare  it  to  the  correct  decision  on  the  case  it  Is 
conridering.  If  the  decisions  match.  system  can  create  a  more  general  rote  (or  just 
leave  the  current  role  in  place). 

However,  if  the  decirions  differ  ti«  system  needs  to  create  a  0^  rule  based  on 

the  new  case.  In  addition,  U  needs  to  examine  how  closely  the  old  rule  matched  the 
curroit  cases.  The  system  derigners  need  to  be  able  to  vary  this  streng*  of  match 
parameter.  If  the  role  does  not  match  very  closely,  the  system  can  create  anew  rule  that 

matches  the  current  case  better  titan  the  old  rote. 

If  the  old  tote  matdies  very  closely  the  system  must  make  a  more  swmtive 
decision.  A  close  match  means  the  system  is  looking  at  a  case  that  is  very  sinular  to 
previous  cases,  but  the  correct  answer  is  different  from  what  it  has  been  in  the  past.  The 
new  case  might  represent  a  change  in  policy  (» in  the  world  e.g.  technology,  and  the  old 
role  is  no  longer  appropriate.  The  system  may  then  decide  to  replace  the  old  role  with  the 

new  one. 


riHUMmiBIMg 


MACHINE  LEARNING  LIMITATIONS 


De^te  its  tremendous  pr^tisL  mschine  leartiins  caimot  solve  every  problem 
(21].  R  only  works  well  for  domains  in  which  t  large  body  of  experience  exists. 
Naturally,  this  experience  should  be  available  on  Une  since  the  effort  of  encoding  it  could 
be  enormous,  Lemtiing  systems  also  might  not  work  weU  for  real-drae  appUc-tions  since 

they  have  to  search  a  large  rule  base  w  find  the  best  rules  for  each  new  simaUcn. 

A  more  rignificant  point  to  keep  in  mind  is  that  Teaming*  systems  cannot  decide 

for  themselves  what  parts  of  the  data  are  important  If  the  miUtary  had  a  very  rich  data 
base  vwA  lots  of  data  for  each  cyst,  Uw  system  engineers  mun  first  decide  which 
information  in  each  case  is  most  important  This  filtering  of  data  almost  always  requires 
die  of  experts,  so  a  modified  knowledge  engineering  role  is  still  part  of  the 

process  of  building  a  learning  system.  If  the  data  is  fed  into  the  program  unfiltered.  the 
contradictions  or  incompleteness,  etc.  In  cases  might  be  so  great  (for  example,  in  the 
form  of  spurious  correlation,  which  would  lead  to  rules  that  could  never  work)  that  the 

program  might  never  adequately  learn. 

Finally,  systems  thm  learn  from  experience  cannot  team  a  principle  that  is  n(H 
embodied  in  the  experience  they’ve  had.  If  miUtary  intelUgence  senses  the  opposing 
force  is  operating  tm  a  different  principle  such  as  conserving  manpower  or  concentrating 
on  air  defences  and  wants  die  teaming  system  to  make  decisions  to  reflect  dial  change. 

the  engineers  responsible  for  the  system  may  need  to  modify  it  manually. 


RESEARCH  ISSUES  IN  CASE-BASED  REASONING 

The  following  section  discusses  research  issues  for  »  CBR  system  [4]. 

Hie  ^ical  reasoning  of  a  CBR  system  involves  selection  of  the  appropriate 
case  in  memory,  modification  of  the  old  case  according  to  the  new  problem,  and  posrible 
storage  of  the  new  solution  as  a  case  in  memory.  Each  step  of  this  cycle  has  many  t^n 
research  issues  associated  udth  it 

Rrst.  die  question  of  how  to  represent  the  case  and  its  features  in  computerized 
form  must  be  addressed  [22]. 

Second,  a  CBR  system  must  select  the  best  case  or  cases  from  memory.  Hie 

question  diat  must  be  answered  is  what  constitutes  an  aj^opriate  case.  What  are  die 
criiteria  of  closeness  or  similarity  between  cases,  and  how  should  cases  be  inctexed.  In  the 
Amplest  approach,  find  which  case  has  the  most  matching  features.  An  important  issue  is 
to  determine  if  the  features  arc  of  the  same  important  [22], 

Third,  a  new  solution  must  be  checked  to  decide  if  it  solves  the  problem. 
evrfring  a  solution  can  take  many  fmms.  Some  situations  allow  the  application  of 
analysis  terhntgtiftit  to  determine  die  goodness  of  a  solutions;  other  situations  may  require 
simulation;  others  may  allow  a  formal  proof  of  solution  correctness.  Whatever  the  means, 
after  a  solution  is  checked  the  results  of  this  check  most  be  evaluated.  If  the  solution  is 
acceiMable.  based  on  some  domain  criteria,  dien  the  CBR  system  is  done  with  reasoning. 
Odmwise.  die  case  must  be  modified  again,  and  this  time  the  modifications  will  be 
guided  by  the  results  of  the  evaluation  of  the  solution. 

Fburdi,  after  an  acceptable  solution  has  been  found,  the  CBR  system  must 
decide  if  and  how  it  should  be  added  to  its  dynamic  memory.  During  this  learning  phase 
the  CBR  system  must  decide  if  the  new  solution  is  sufficiently  different  firom  others, 
already  known  ones,  to  warrant  storage.  If  it  does  warrant  storage,  it  must  be  decided 
bow  the  new  case  will  be  indexed,  on  which  level  of  abstraction  it  will  be  saved,  and 
where  it  will  be  put  inside  the  dynamic  memory  organization. 


Indexing  t  case  is  essential  in  establishing  similarity,  since  the  Indices  help 
define  the  elements  of  a  problem  that  are  important  and  which  should  be  considered 
when  studying  a  problem.  Part  of  the  case  is  the  knowledge  gained  &om  solving  the 
problem  represented  by  the  case.  In  other  words,  cases  should  also  be  Indexed  by  some 
elements  of  the  solution.  According  to  the  theory  of  dynamic  memory  the  events  that 
help  most  in  reminding  are  failures:  we  remember  situations  where  our  expect^ons 
failed  easier  than  situations  which  were  stereotypical  and  according  to  expectation. 
Thus,  any  indexing  scheme  should  Include  failures  and  deviations  from  stereotypical 
events.  Two  main  approaches  exist:  Ftot,  hierarchical  approaches  arranged  features 
from  general  to  specific  i.e.  a  decision  tree.  This  is  most  suited  for  domains  using  well 
defined  searches  [221.  The  associative  i^proKh  involves  linking  features  independently 
diis  allows  more  flexible  searches. 


BRIEF  COMPARISONS 


How  does  CBR  compare  to  other  AI  approaches  [22].  In  comparison  to  rules, 
development  time  Is  ^nt  creating  features  from  cases  rather  than  trying  to  articulate  an 
expert’s  heuristics.  In  addition,  a  CBR  provides  better  explanations  of  decision  by  direct 
links  to  previous  deciaons  rather  than  through  a  "distilled"  rule  base.  This  is  also  a 
problem  with  neural  nets  which  can  not  provide  explanations  for  their  classifications  of 
new  problems.  Once  the  system  has  generated  a  set  of  strategic  or  tactical  plans. 

personnel  could  then  enhance  it  by  deviang  creative  and  unexpected 
modificatioos.  Thus,  receiving  explanation  of  how  the  plan  was  developed  is  extremely 
important  in  assessing  its  strengths  and  for  use  in  extending  or  refining  the  computer 
generated  plan. 
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CURRENT  STATUS  OF  CBR  SOFTWARE 

Cunently  there  appear  to  only  be  two  publicly  available  CBR  software  systems, 
flicy  are  iela!»vely  expensive  (>$10,000  US)  systems:  Remind  by  Cognitive  and  CBR 
&q>iessby  Merence  (sec  review  in  October  1991  issue  of  "AI  Expert*). 

CONCLUSIONS 

tliis  paper  described  a  mediodtology  called  case-based  reasoning  which  could 
have  potential  in  developing  both  strategy  and  tactical  offensive  and  defensive  plans.  It 
Bummuized  a  list  of  research  isaies  which  mart  be  addressed  both  a  fbUy  automated 
^stem  could  be  develc^d.  However,  sudi  tm  approach  could  be  the  foundation  for 
generating  battle  plans  which  draw  upou  accumulated  military  experience. 
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AmJCATIOm  OF  EXPERTS  SYSTEMS  IS  DSD 
EMC,  tS/igstm  OwiaWbv  CmtUa 


A  DECISION  SUPPORT  SYSTEM  FOR  ELECTRONIC  WARFARE  ANALYSTS 
Mi^  J.Q.L  Dumouchel*  and  Dr  AL 
Abstract 

One  of  the  main  goals  of  Electronic  Warfare  (EW)  Is  to  Identify  enemy 
tmits  and  determine  their  bitentions.  This  is  accomplished  tfirough  the  analysis  of 
data  obtained  by  Electronic  Warbve  Support  Measures  (ESM).  One  of  the 
techniques  err^kiyed  by  EW  ana^sts  te  to  use  d^loyment  templates  as  define 
in  doc^al  publications  to  predict  the  (topioyment  and  lntentk»is  of  the  enemy 
forces  facing  our  own  forces.  This  pt^  presents  a  i^’oti^ype  Decision  St^sport 
System  03^)  written  in  the  SmalltaSc  programming  ianguage.  It  makes  use  of 
doctrinal  templates  to  assist  toe  EW  analysts  in  estimating  enemy  locations, 
identities  and  intentions.  Initial  reactions  to  toe  DSS  suggest  it  is  a  toot  toat  atill 
greatly  enhance  toe  working  environment  of  the  EW  analysts. 


'Project  Manager,  Director  Signab  Engineering  and  Mainrerauioe,  NDHQ,  Ottawa 
^Ptofeaaor,  Dept  of  Enpneering  Management,  RMC,  Kingston 


tMMOOCXXm 


W,  irtileb  is  dsflBsd  as  sdlitsry  aetioos  involving  tbs  nss  of 
sisi  t  rfsqnstlr  snssgy  to  dstscainsr  sxploitf  xsducs  or  prsvsnt  bostils  oos 
of  tbs  slsetreosgnstie  spsotru*,  sad  notions  to  cstsia  its  ass  hf  frisndly 
foMwSr  bss  bssn  praetissd  in  svsry  osjor  eonfliet  sines  radio 
iiinunlnirlrnn  oars  first  ossd.  IV,  aXtboagh  an  iatsgral  port  of  air  and 
naval  opsratioas,  vaa  gsnsrally  igaorsd  by  vsstsm  amiss  aftsr  World  War 
tt  nntil  tbs  vistnaa  war.  today,  inersaasd  sfforta  ars  bsing  dsvotsd  to 
Shis  eritieal  eosponsat  of  eeBd»at  power.  Modsm  warfars  is  bseoaing 
inersaaingly  dspsndant  on  high  tsehnology  eooaiand  and  control,  sorvsiX lanes 
^nwi  weapon  systsas,  tbs  nsjority  of  ^icb  nss  sons  portion  of  tbs 
slsetrosMgnstie  spsetma  for  guidance  and/or  eosnunications.  The  side  that 
best  audBss  nss  of  tbs  slsetrestagnetie  spsetma  and  rsdoess  tbs  samy's  nss 
of  tbs  ssM  spsetma  will  have  a  dseidad  advantage  in  winning  tbs  war. 

■LKavone  wairuui 

iw  tl)  sotoaess  tbs  following  three  divisional 

a.  ilbctronie  Warfare  Support  Msasttrsa  (ESM» I 

b.  ilsctmnie  Counter  Msaaurss  tECM)>  and 

e.  glsetmeie  Counter  Counter  Haasurss  (BCCM). 

VCCM  are  the  defensive  asasurss  taken  to  protect  friendly  eleetronio 
syotsM  sgainst  the  eneay  threat.  ICM  are  aetions  taken  by  friendly  SW 
units  to  prevent  or  rsduee  tbs  enaagr's  uaa  of  the  electronagaetie  spsetma. 
UN  involve  actions  taken  to  search  for,  intercept,  locate,  reeord  and 
analyse  radiated  eleetroaagnetie  energy  for  the  purpose  of  esploiting  such 
radiations  in  support  of  ailitary  operations.  ISM  provide  a  source  of  EV 
feion  reqpiired  to  conduct  ICM  operations,  BCCM  planuing,  threat 
Mleetioa,  warning  and  avoidance,  target  acquisition  and  warning.  The 
divisions  of  EW  and  their  relationship  with  other  BW  terns  can  be  best 
illustrated  as  in  rigors  1. 


Offensive 


Defensive 


ESM 

(passive) 


Seerch 

Intercept 

Direction-finding 

Analysis 


gOM 

(active) 


Tactical 

Tecnnicai 

Procedural 


Jamming  Deception 


Simulative 

Manipulative 

Imitative 


Tieor*  1  »  SW  fiBlly  tr«« 


OB  aiSD  fOK  JMROMUID  SmLTSZS  - 

m  !•  an  aetivity  that  haa  aavaral  intar-ralatad  and  iatar-dapandant 
«  yX^pura  2  avwiiairiaaa  tha  antiica  EW  procaaa#  Tha  aappoirtad 
BMda  information  about  tha  anaoy  daploynant  and  intantions  to 
affaetivaXy  daploy  hia  own  formations.  Ona  of  tha  many  aoureas  for  this 
i*  tha  EW  unit  nndar  his  eoanand.  Tharafora,  tha  oentandar, 
throaeh  bis  staff,  givas  diraetiona  to  tha  EW  unit  as  to  tha  typa  of 
information  ha  raqniras  to  fomnlata  his  plan.  This  is  known  as  tha 
eosaandar's  Primary  Information  Hsqairanants  (PZRs)  and  Information 
Itoqairaaants  (ZEs).  Tha  BW  unit  oparations  cantra  translataa  thasa  PZRs 
and  ZRs  into  tasks  to  ba  parfomad  by  tha  warioua  datachmants  daployad  by 
tha  unit. 
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rigan  Z  ^  Win  process 


tte  analysts  vill  provida  staarags  to  tha  aaarch,  ixitaroapt^  diraotion- 
finding  and  jaaning  datachmnta  in  tha  form  oft 

a*  kaoM  fraquanolaa  in  nsa  by  tha  anas^; 

b*  typaa  of  signals  osad  (a.g.  soiea,  aorsa  coda  or  anoryption); 
o«  knoim  callsigns  osad  on  a  spacifie  radio  natworki 
d*  codawords  coaanonly  osad  on  a  particular  radio  nattpork;  and 
a»  tha  location  of  knoim  aadttars. 

Csing  tha  data  obtained  from  1SK«  tha  SIT  analysts  produea  reports 
for  tha  supportad  coaanandar  and  his  staff.  Tbmmm  raporta  typically  provide 
tha  following  infomationt 

a.  tentative  identification; 
b*  last  knom  location; 

c.  predicted  intentions; 

d.  approximate  time  shan  tha  action  will  taka  place;  and 
a.  general  connsnts  from  tha  analysts. 


With  thm  intelllgttnc#  obtained  fron  thaaa  raporta  and  othar  aourcaa 
of  .information,  tha  eoanandar  makaa  daciaiona  and  givaa  diractiona  to  tha 
imita  and  formationa  nndar  hia  ooamand  to  aithar  phyaicaliy  or 
alactronically  attack  tha  anai^.  Xn  tha  eaaa  of  ECM  taaka  (alactronie 
attack) ,  tha  analyata  will  provida  tha  KK  controllar  with  f raquanciaa  and 
locationa  of  targat  amittara. 

hnalyaia  oonaiata  of  acrutiniaing  all  aaailabla  information  and 
extracting  that  ahich  ia  important  to  the  intalliganca  procaaa.  rigura  I 
portraya  tha  intalliganca  procaaa* 

from  intarcapt,  tha  analyata  racaiva  infor4kation  about  fraquanciaa, 
callaigna,  typaa  of  natworka,  maaaaga  eontant,  traffic  flow,  activity 
pattama  and  trananioaiona  typaa*  this  information  ia  furthar  anhancad  by 
information  on  locationa  and  poaaibla  mcxrmmnt  of  cmittara  provided  by 
diractioa-finding  datachmanta*  Other  aourcaa  of  information  auch  aa  air 
raconnaiaaanca,  apacial  forcaa,  battlefield  aurvaillanca  and  vaepon 
locating  radara  aa  wall  aa  priaonara  of  war  add  to  tha  maaa  of  data  to  be 
aeratiniaad* 

The  target  arxray  facing  ax!  EV  unit  oan  be  liiuga  and  aophiaticatad* 
for  axarpla,  it  could  be  up  to  175,000  amittara  in  tha  caaa  of  an  army 
patterned  along  the  linaa  of  tha  old  Waraaw  Pact  organiaation 
Obvioualy,  all  thaaa  amittara  are  not  active  at  tha  aaaa  time*  Bowavar', 
prior  to  tha  conduct  of  any  oparationa,  an  EW  unit  vill  have  gathered  acme 
information  about  tha  mxmay  amittara  while  building  a  databaaa  of 
information  about  tha  ^ponant  force*  Tha  analyaia  of  thia  information 
vill  raault  in  raporta  to  tha  HI  C Intalliganca'.  and/or  03  (Oparationa) 
ataff  containing  intalliganca  concerning  tha  anai^  order  of  battle  (ORBAT), 
ita  atrangtha  and  intantiona,  and  unit  idantitiaa  and  equipment* 

One  can  aay  that  tha  EW  analyat  ia  a  detective  who  quickly  aaixaa 
upon  any  arrora  or  braachaa  of  aacurity  coomittad  by  tha  enemy*  When  tha 
opposing  force  aacurity  maaauraa  are  affective,  tha  information  obtained 
vill  be  very  fragmented  and  vill  only  gain  clarity  over  a  long  period  of 
time.  Bowavar,  time  ia  an  advantage  the  analyat  does  not  have* 
Accordingly,  ha  needs  some  form  of  assistance  to  build  up  tha  enemy  picture 
aa  fast  as  possible  and  as  accurately  as  possible* 
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iuudyiits  1IM  4i£f«r«iit  taclmifiiM  to  ovaluoto  thm  toctieol 
itiformotioa  ocquixod  BSd  mud  othor  oottreos*  Om  of  thoso 

toehniquos  im  eallod  tooplating*  Zt  nfors  to  tho  om  of  doploymnt 
as  daflMd  la  tbo  anaay'a  doctrinal  poblioations  to  prodiet  tlto 
doploynsut  and  iatontiona  of  tho  oaoay  forooo  facing  our  own  forcoo*  ha 
oaaoplo  of  ouch  tonplato  io  ohoim  at  Figaro  4*  Thooo  toi^Iatoo  mhtm  tho 
Major  oloaoato  of  a  formation  or  unit  oo  noil  as  thoir  rolatioo  pooitiono 
to  oach  othor  and  tho  Forward  Bdgo  of  tho  Battlo  hroa  (FEBA)  •  Cownandoro 
at  all  XoFolo  %rill  normally  comply  to  thooo  tomplatoo  idiilo  planning  thoir 
doploynont  bocauoo  doctrino  oaually  affords  thw  vory  liaitod  latitude. 
Conooquontly«  thooo  toa^latoo  aro  a  oory  important  tool  for  tho  analyst 
bocauoo  it  allows  thorn  to  doduco: 

a.  onomy  intontiono.  Tho  typo  of  tonplato  that  boot  match  tho 
actual  doployaont  will  indicato  tho  typo  of  oporationo  to 
oscpoct  from  tho  onoay  (o.g.  attack^  dofoneo  otc)|  and 
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b.  eoi«>o«ltton  of  tbm  tmpUtm  will  pro.pt  tb.  , 

•Mlyat  M  to  tbo  major  alowiata  to  oxpoet  to  find  in  tho 
oppooont**  cait  or  formation. 

Moat  of  tho  information  gainad  from  sm  ean  ba  aaaily  handlad  by 
maehiaaa  without  tba  naad  for  hcmas  intarrantion.  Xt  alao  appaara  that  tha 
naa  of  taaiplataa  will  land  Itaalf  rathar  handily  to  autoaiatlon. 
Consaquaatly,  daaignlnfl  a  ayatam  e*4>abla  of  eoa«>aria«  tho  tactical  data 
fatharad  through  SSH  and  other  aourcaa  to  diffarant  doctrinal  taiaplatea 
knowc  to  ha  usually  usad  by  tha  anaiv  will  graatly  anhanea  tha  analyst's 
ability  to  eqpa  with  tha  anotaious  amount  of  infozmatien  availsbla  from  tha 


rigura  4.  typical  doctrinal  tmplata 


■K  Moufx  ■mm 


fiM  m  ABalyst  aystM  (BMES)  i«  •  mrttMU  that  la  4asl9iMd  to  «ao 
aoetriaal  taaplatoa  aasiat  th*  W  analyata  la  tho  porfoxMaco  o* 

ttwtr  4atiM.  It  waa  ^ro^ramad  oa  a  aioroeoavatar  uaiaf  tha  taalltalk 
{3,4fSr7]  oarlroaBMiat.  fbm  Major  faataraa  of  tha  aystm  arat 

a.  a  Mladew-baaad  aaar  iatarfaea; 

h.  aa  latarfMO  with  a  datahaaa  of  doetriaal  taaplataa  toi 
I)  add  or  dalata  eata^oriaa  of  tasqplataa; 
aj  add#  dalata  or  raaaaM  ty^aa  of  taa^lataai  and 

1)  add#  inaort  or  dalata  aa  alaaant  la  a  flvan  taaplatai 

o.  aa  iatarfoca  with  a  tuetloal  datahaaa  tot 

1)  add#  dalata  or  ranaaa  aalta  la  tha  databaaai 
1)  add  or  dalata  eharaotarlatlea  of  a  anlt;  and 
S|  aaaroh  a  datahaaa  of  lafarrad  (doctrinal)  taaplataa  f®* 
poaalhla  aatebaa  to  a  tactical  unit; 

d.  aa  latarfaca  with  aa  Infaranca  calculator  toi 

1)  daflna  an  Infarrad  (doctrinal)  toq^lata) 

2)  ealculata  tha  atqpactad  location  of  aach  alaaant  of  tl» 
infarrad  twpplata)  and 

I)  add  tha  infarrad  taaplata  to  tha  datahaaa  of  infarrad 
'  taaiplatao} 

o.  aa  latarfaca  with  a  datahaaa  of  inf arrad  taq^lataa  to  aaareh 
tha  tactical  datahaaa  for  a  poaalbla  Batch  to  aa  olaBoat  of 
tha  aalaetad  taaplata  or  tha  aalactad  tar^lata  Itaalfi  aad 

f.  tha  ahillty  to  coaipata  a  certainty  factor  for  aach  Batch. 

Aa  tha  ayataa  raquiros  doctrinal  tM^lataa  from  idilcb  to  conpara  tha 
gatbarad  inforaation,  a  Tai^lata  Oatabaaa  Browaar  la  provldad  to  tba  EW 
analyat  to  parmit  hia  to  antar  dlf  farant  doctrinal  taaplataa  in  a  datahaaa . 
Tbia  browaar  la  ahown  at  Flgiira  S. 


5  •  DatabM#  Brower 

ThiM  teoimw  has  ssvsn  (7)  panss  alloniiiB  ths  W  analyst  toi 

a*  a4dt  smovs  or  rsnaas  a  eats^ory  of  tasqplats  <pans  !)•  this 
pans  lists  all  ths  catsgorlss  of  doctrinal  tsxoplatss  hold  in 
ths  systssi*  Bach  cats^ry  of  tssplats  rsfsrs  to  a  diffsrsnt 
phass  of  sar  (s.f.  attack^  dsfsnes,  ste)| 

h*  add  or  r^***^***^  a  typs  of  tssplata  associatsd  vith  ths  sslsctsd 
cstspory  of  tsnplats  (pans  2)  •  Ths  typs  of  tsnplats  rsfsrs  to 
ths  ty^  of  unit  or  foraation  that  tsnplats  rsprsssnts 
{arwcorsd,  infantry,  artillsry#  stc).  This  pans  displays  all 
ths  tsnplats  that  ssrs  put  in  for  ths  sslsctsd  catsgory  of 
tsnplatss; 

c#  add,  rsflsovs  or  inssrt  an  slMsnt  for  a  sslsctsd  typs  of 
tsnplats  (pans  3).  An  slsnsnt  rsfsrs  to  a  major  unit  or  sub* 
unit  of  ths  unit  or  formation  rsprsssntsd  by  ths  sslsctsd 
tsaplats*  Bsncs,  this  pans  shows  all  ths  slsasnts  that  should 
bs  part  of  ths  givsn  tsaplats; 


d.  mtsr  th*  d*pth  and  frontaga  of  a  aalaetad  typa  of  taaqplata 
(paaaa  4  and  S).  Thla  alloas  tba  aaalyat  to  adapt  tba 
taa^lata  to  tba  tarrala  sinea  tarrain  la  a  aMjor  factor  ia 
diotatinp  bow  foreaa  ara  d^^Ioyadi  and 

a.  antar  a  waloa  for  tba  aaatlng  and  nortblnp  of  aaob  alanaat  of 
tba  aalaetad  typa  of  taaplata  (panaa  C  and  7).  Thla  lata  tba 
aaalyat  poaitloa  aaeb  alaaaat  witbln  tba  taaplata. 

ttia  browaar  will  ba  aaldoa  oaad  during  oparatlona.  Vba  dlffaraat 
doctrinal  tanplataa  abould  ba  known  to  tba  IV  analyat  prior  to  tba  atart 
of  boatlUtlaa  and  antarad  In  tba  ayataa  at  that  tlaM.  Tbla  browaar  will 
ba  Btalnly  oaad  to  aodlfy  tba  tanplataa  to  taka  account  of  tba  warlatlona 
la  tba  tarrala  and  to  ebangaa  In  doetrlaa. 

ba  pravlottaly  nontlonad,  laforaatlon  la  balag  gatbarad  a  Httla  at 
a  tliM  and  tba  IV  aaalyat  naada  a  tactical  databaaa  to  kaap  track  of  It 
all.  Xn  tbla  ayataa,  ba  will  ba  abla  to  atora  all  tba  Infomatloa  gatbarad 
frea  warloua  aoureaa  by  ualag  tba  tactical  Databaaa  Browaar  (Flgura  4). 


rlgura  6  -  Tactical  Databaaa  Browaar 
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ll , 

this  bronMT  also  liu  savait  (7)  putM  tad  prorld**  th«  W  «n»ly»t 

with  th*  £ollowia9  iafoimatieai 

a.  V«M  1.  this  puM  qtr—  a  Uat  ®£  all  aaaav  w»ita  aad 
fotMtlons  bald  la  tha  tactical  databaaa.  »ha  W  aaalyat  eaa 
add«  gaaoaa,  caaaBB  or  try  to  match  a  oalt  from  thla  paaa. 
Wiaa  a  ualt/formatloa  la  aalactad,  tha  ayatam  mill  dlaplay  tba 
alaetroolc  charaetarlatl<r;  of  that  oalt  la  tha  othar  paaaa 

.  ^  ;  tha  hrowaarr  ' 

b.  Paaa  2.  thla  paaa  ahoma  a  lUt  of  all  tha  fraquaaolaa  kaoim 
to  ba  oaad  by  tha  aalactad  oalt.  »ha  ayatam  allowa  tha  Wl 
aaalyat  to  add  or  raaova  a  fraqaaocy  from  thla  llat» 

c.  tana  3.  h  llat  of  all  typaa  of  alanal  tooim  to  ba  ooad  by  tba 
aalactad  unit  la  dlaplayad  la  thla  paaa*  tha  BW  aaalyat  oaa 

or  xanova  aa  antry  from  thla  llati 

4.  paaa  4.-  tha  pana  dlaplaya  all  tha  aodaa  (aub-tmlta/unlta) 

tha  aalactad  unit,  tha  ayatam  lata  tha  W 
aaalyat  add,  ranova  or  try  to  match  a  noda  from  thla  pana. 
ooea  a  aoda  la  aalactad,  tha  ayatam  mill  dlaplay  tha 
aiaraetarlatlca  of  that  noda  la  panaa  5,  4  and  7; 

a.  Pana  8.  thla  pana  dlaplaya  a  llat  of  tha- dlffarant  codaworda 

hm  used  by  tha  aalactad  nnlt/fomatlon.  tha  IW 

aaalyat  eaa  add  or  ramova  a  eodamotd  from  thla  pana; 

f.  Pana  4.  thla  pana  dlaplaya  tha  laat  kno%ni  location  of  tha 

noda.  thla  lafoxmatloa  mould  aexmally  ba  obtalaad 
from  dlractlon  finding  aanaora  and  automatleally  antarad  In 
tha  databaaa.  tha  BW  analyst  haa  tha  ability  to  ebanga  thla 
Information  mhan  ragulrad;  and 

g.  Pana  7.  tha  noabar  of  tranamlaalona  amanatlng  fro*  tha  noda 
la  antarad  In  thla  pana.  Again,  thla  nuadsar  mill  ba  updated 
automatically  from  Information  racaivad  from  tha  intarcapt 

oparatora  poaitlona.  tha  BW  analyat  also  haa  tha  ability  to 

ebanga  tha  information  in  thla  pana  If  nacaaaary. 
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dw  BW  utalyit  irill  osaaXly  ns*  this  brow»«r  to  th« 

Infonutloa  bo  oooda  to  provide  otoorago  to  tbo  difforont  aonaors  deployed 
by  tbe  unit.  Be  will  alao  oae  the  infonnatioa  eontaiaed  ia  tbia  bromar 
to  iaitiate  a  aeaxeh  of  tbo  iaforred  (doetriaal)  taaplatea  to  find  a  mteb 
betweea  tbe  deployaeat  of  tbe  aeleeted  oait/foraatioa  (paae  1)  or  a 
aelaeted  node  (paae  4)  aad  a  doetriaal  taaplate. 

as  Matioaed  earlier,  tbe  terrain  playa  aa  isportaat  part  ia  tte  way 
a  nait/forBatioa  will  deploy  bis  forces.  Za  aaay  iastaaces,  tl» 

dsployawat  will  not  eonform  to  the  dootrlne.  Therefore,  there  is  a  seed 
to  aodify  the  doctrinal  taaplatea  to  eoafoxm  to  the  terraia  on  diieh  the 
battle  is  being  fought.  Also,  the  terraia  will  dictate  the  possible 
avenues  of  approach  to  the  friendly  position.  The  W  analyst  can  change 
the  sise  and  orientation  of  an  inferred  (doctrinal)  te^late  by  ttsing  the 
Znforenee  Calculator.  An  exaaplo  of  this  browser  is  showed  in  Figure  7. 
Tbe  calculator  has  seven  (7)  panes  idtich  allow  tbe  BW  analyst  to  t 

^  category  aad  type  of  tei^late  to  be 

inferred.  Panes  1  and  2  list  all  the  tei^lates  that  can  be 
inferred  by  category  (pane  1)  and  type  (pane  2)..  The  lists 
are  identical  to  the  lists  found  in  the  TeBg>late  Database 
■  Browser; 

b.  enter  certain  attributes  for  a  given  te»®late.  These  are» 

1)  |.nferenee  coordinates.  Pane  3  lets  -the  BW  analyst  enter 
tbe  point  on  the  mp  idtere  the  teig>late  will  be 
inferred.  Zt  is  the  intersection  of  the  line 
representing  tbe  PB8A  and  the  line  representing  the  left 
boundary  of  the  unit  or  foraation  for  idiieh  the  tsnplate 

V  is  inferred; 

2)  ancle.  Pane  4  allows  the  BB  analyst  to  enter  the  angle 
of  tbe  axis  of  advance  (suspected  or  known)  of  tbe  ensiqr 
forces  with  respect  to  the  deploynsnt  of  friendly 
forces; 

3)  depth.  Pane  S  lets  the  BN  analyst  detersdna  the  depth 
for  tbe  tenplate  that  will  best  natch  the  terrain  over 
idiicb  the  battle  is  taking  place;  and 
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4)  frontage.  Pan*  (  lata  tba  ID  analyst  dataraina  ^ 
frontafa  for  tba  taaqplata  that  will  also  bast  suit  tba 
'  ;  .  tarraini  and 


e.  tba  infarsad  taa^lata  to  a  databaaa  of  infarrad  tai^latas . 

Pans  7  lists  all  tba  alaaants  of  tba  salaetad  taaplata  with 
eorraspondinf  infarrad  location.  Baeb  infarrad  tawplata 
will  ba  storad  in  tba  databaaa  of  infarrad  taaplatas  with  its 
atU'ibutas  and  a  list  of  alasants  with  tbair  associatad 
infarrad  location. 

Tba  m  analyst  will  osa  tba  Xnfaranca  Calculator  to  infar  all  tba 
tai^latas  ba  f aala  ara  appropriata  for  tba  typa  of  tarrain  and  tba  stata 
of  bostilitias.  Sinca  tba  supportad  cosnandar  is  only  intarastad  in  anany 
actions  in  a  spacific  araa  of  tba  battlafiald,  tba  BW  analyst  will  nomally 
Infer  all  tba  possibla  taaplatas  that  could  cowar  tba  said  araa. 


aftar  tba  BW  analyst  bas  infarrad  a  sat  of  tasplatas  and  storad 
tbaa,  ba  wost  ba  abla  tw  work  with  tbasa  tanplatas.  Tbis  can  ba  dona  by 
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oslag  th*  Z&f«rr«d  Taioplatas  D«t«bM«  Browaar  (I’lgur*  t).  Tbit  bromtr 
•lao  hat  aavan  panaa  allowing  tha  BW  aaalyat  to  gati 


Pigura  I  •  Znfarrad  Tamplataa  Oatabaaa  Browaar 

a.  tha  liat  of  inf arrad  taavlataa  bald  in  tha  databaaa  of 
infarrad  taaq^lataa.  Bana  1  allowa  tba  B»  analyat  to  ranova  or 
ran«M  an  infarrad  taaplata  or  npdata  tha  browaar) 

b.  tha  attributaa  of  tba  infarrad  taaplata  that  ia  aalaotad. 

;  Tbaaa  arat  ' 

l>  typa  of  taaplata  (pana  2); 

2)  infaranea  eoordinataa  (pana  2)) 

3)  angla  of  tha  axis  of  adranca  (pana  4); 

4)  daphh  of  tba  infarrad  taaplata  (pana  S))  and 

5)  frontaga  of  tha  infarrad  taaplata  (pana  4); 

e.  tba  liat  of  all  alasMinta  aaaoeiatad  with  tha  aalaotad  infarrad 
taaplata  and  thair  infarrad  location.  Thia  pana  allowa  tha  EM 
aaalyat  to  oaa  tba  ayataa  to  natch  an  alanant  of  tha  infarrad 
taaplata  to  a  noda  in  tha  tactical  databaaa  or  to  natch  tha 
aalaotad  infarrad  tanplata  to  a  unit/foxnation  in  tha  tactical 


databaaa. 


VoiTf  thm  Mm  can  ua#  tha  ayata*  to  tty  to  daduca  tha  aiiaay'a 

daployfMnt  ud  Intantions  tm  \mll  u  to  provido  otMrago  to  tho  fonmrd 
•oBooro.  Thl»  coa  bo  dono  in  two  w«y«.  Tift,  tho  W  onolyot  eon  uoo  tho 
Bo  ootch  on  inforrod  tooploto  ho  £oolo  boot  doncriboo  tho 
anlt/fonution  ho  thlako  toeoo  oor  own  foreoo  to  o  onit/fornotion  hold  la 
tho  dotobooo.  tfhio  io  dono  from  tho  Xnforrod  Toaplotoo  Ootobooo 

•rowoor.  tho  roonlt  of  tho  oooreh  will  bo  ohown  in  tho  Hotebod  toetieol 
Ootoboao  Browoor  iriguro  9). 


Viforo  t  >  Motehod  toetieol  Dotobooo  Browoor 


thifl  browoor  io  idontleol  to  tho  toetieol  Dotobooo  Browoor  oxcopt 
for  tho  followings 

o.  pono  1  lioto  only  tho  onita/fomotlono  thot  hovo  Mtchod  tho 
inforrod  tonploto  along  with  o  eortolnty  factor  oaooeiotod 
with  ooeh  aoteU;  and 
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b.  p«tM  4  aov  abows  tha  eartmlnty  factor  for  aach  alaaant  to  aoda 
■ateh  aa  wall  aa  tha  liat  of  all  nodaa  aaaoclatad  with  tba 
aolaetad  aatehti^  oait/fonutlon. 

Ob  tba  etbar  band,  if  tha  nr  analyat  knowa  tha  Idantlty  of  tha  anaay 
BBlt/fonuitioa  faeia9  our  own  foreaa  but  raqniraa  aoro  iafotaatloa  about 
It,  ho  eaa  do  ona  of  two  ^parationat 

a.  aalaet  tba  unit/f oraatloa  froai  tha  liat  in  pana  1  of  tba 
Tactical  Oatabaaa  brovaar  to  gain  aceaaa  to  all  tba 
inforaatioB  available  about  tha  unit/fomatioB  that  ia  bald  is 
tha  ayataa.  Tba  nr  analyat  can  than  uaa  tha  infonaation  to 
ataar  tba  diffarant  aanaora  daployad  by  tha  ni  unit;  and 

b.  iaitiata  a  aaarch  of  tha  Znfarrad  Taa^lataa  Oatabaaa  in  ordar 
to  datarmina  if  tha  aalactad  unit/forBation  haa  a  Batch 
aaoBfat  tba  Znfarrad  Tmplataa.  Tba  raault  of  thia  aaarch 
will  ba  abown  in  tha  Natcbad  Znfarrad  Tanplataa  Oatabaaa 

■  Irowaar  (Pigora  10). 


rigura  10  «  Matchad  Znfarrad  Tas^lataa  Oatabaaa  Browaar 
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Th4«  broHsar  is  idsntlesl  to  tbs  Xnfsrtsd  Tss^lstss  Dstsbsss  Browssr 
with  ths  fuUowing  axcsptionst 

s.  pans  1  coatsins  s  list  o*  ths  Infsrrsd  tsB5>l*tss  that  hsvs 
■atobsil  tbs  ssisotsd  onlt/tonsstioB  or  s  nods  witb  sa 
assoeistsd  eartsiaty  factor)  sad 

b<  paas  7  iaeladas  a  list  of  all  tbs  slsawnta  of  aa  iafarrsd 
taaplats  witb  tbs  assoeiatad  aatebad  aodas  iaeludiag  tbs 
esrtalaty  factor  assoeiatad  vitb  aacb  aateb* 

troai  this  bromar,  tbs  W  aaclyst  can  datarmiaa  tha  aaaay*a 
iataaUoos  from  tba  typo  of  taaplata  that  aatchaa  its  actual  daployaant. 
■a  eaa  also  dataraiaa  wbicb  lafc^tiwi  is  aissiap  froai  tba  oooparativa 
list  of  aatehaa  batwaaa  alanaata  sad  aodas. 

mXaaaata  that  haua  ao  aatcbad  aodas  iadieata  that  a  aajor  aub-uait  of  tba 
oait  or  aait  of  tba  fomtioa  baa  aot  baaa  loeatad  yat.  Tba  *l»  aaalyat  eaa 
thaa  usa  this  iaforMtioa  to  ataar  lai  datachnaats  to  try  to  locata  tba 
adaaia9  aub-uaita/ualta  to  eoaplata  tba  tactical  picture. 

■  cn  anmuam  ncKm  '  ■ 

Miay  alaaaats  will  iatroduea  a  SMasura  of  tiaeartaiaty  in  tha  atta^t 
to  idaatify  tba  oaaBqr'a  daployaisot,  atraoTtba  aad  iataatioas. 
OoQS«qaaatly>  it  is  iaportaat  to  bava  a  asasura  of  tha  goodasas  of  any 
■ateh  aebiavad  by  tba  ayatao.  Thasa  aatebas  ara  datasaiaad  usiag  only  tha 
loeatton  of  tba  alaaants  or  aodas.  Sines  tba  location  of  an  olamant  or 
nods  is  dafinsd  in  taraa  of  a  valua  on  tba  "X"  axis  and  a  ualua  on  tha  "T* 
axjji,  it  is  eonsidarad  a  two-distansional  randoai  variabla. 

Tba  eartaiaty  factor  (CF)  for  a  natch  by  tba  syatam  is  dafinad  as: 
cr  •  Probability  that  a  point  |X,,T»)  is  within  a  distancs 
of  tba  point  (X„Ta)  wbara 
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It 

Xt  im  mmm^mmS  th«  VAndom  wiabla  foXIom  «  tw-KiiMnaion^l  Vornal 
Distribution  dsfinsd  ovsr  ths  srss  *»*  ifhsrs  *R*  is  dsf  insd  as 


(/Un^*^(Ay)*RJR  •  probability  of  aatebing  a  noda  to  an  sIssMnt  is 


gissa  by 


p...-if 


TtM  cr  for  Mtehinf  •  unit  to  •  twnplat*  or  Tie*  vorsa  la  qiyn  by 
a  Cbl-Squared  dlatrlbution  vlth  ”b*  da^raaa  of  fraadot  aliara  a  la  tba 
miBbar  of  aodaa  or  aiaaaata  to  ba  aatcbad  (t,f3.  Tba  probability  of 
gattlag  a  Batch  la  givaa  by 


B_«a-t  t*e't 


abara 


Tba  nos  rapraaanta  a  giant  atap  forward  froai  tha  praaant  aanual 
aystwB  in  uaa  la  aa  BW  nait.  xt  providaa  tba  BV  analysta  with  tha 
following  er^jtabllltiaat 

a.  qniek  aeeasa  to  tba  tachnical  data  bald  la  tba 
databaaa} 

b.  ability  to  staar  BW  and  othar  aanaora  worm  afficiaatly  through 
a  gulckar  accaaa  to  tha  tachnical  data  raquirad  by  thaaa 
aanaora; 
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c.  rapid  infaranoa  of  any  n»ad>ar  of  taaplatas  that  can  eovar  tha 

ontira  taB«a  of  daploymnt  poaalbilltlaa  that  coaid  ba  wad  by 

tha  anaaqrt 

d.  •atchin^  of  data  fro«  tha  tactical  database  to  Infarrad 
taaplatas  to  dataxmiaa  tha  anasgr'*  intantionaj  and 

o.  infarrad  taaplatas  to  actnal  tactical  data  to  confirm 

onaiV  daploywnts  and  identify  missing  units/  sub-units. 

«basa  capabilities  allow  tha  BW  analysts  tha  ability  to  datarmina 
anaav  intantiow  and  possible  daploymants  more  rapidly  and  more  accurately, 
this,  in  turn,  allows  them  to  produce  more  accurate  reports  to  meat  tha 
supported  eoa«andar's  *l»s  and  XRs.  WAS  allows  BN  analysts  to  cops  more 
efficiently  with  a  large  amount  of  data  awailabla  from  all  sources.  A 
dammistration  to  personnel  in  tha  BN  units. indicated  that  BNAS  is  a  first 
step  towards  tha  daaalopmsnt  of  a  comprahansiva  system  in  support  of  the 
BN  analysts. 

.•  MwanureMtioNS 

tbs  following  isprowanants  should  be  considarad  to  further  enhance 

ENASt 

a.  dasalop  or  acgulra  a  digital  map  display  system  to  allow  BNAS 
to  display  tha  information  on  a  map; 

b.  dawalop  a  graphics  package  wing  icons  to  allow  tha  display  of 
the  taaplatas; 

g.  dawalop  a  software  package  that  will  give  BNAS  the 
"intalliganca*  to  interface  with  tha  mapping  system  and  modify 
tha  taiplatas  by  taking  into  account  tha  terrain  faattiras  such 
w  lakas,  mountaiw  and  built-up  areas;  and 


aodify  BNAS  to  integrate  tha  tactical  databwe  and  the 
databwa  of  infarrad  templates  into  a  Single  database  from 
idiich  all  tha  information  will  be  obtained. 
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,  Abstra^ 

Aircran  sarvteaabinty  ia  the  ratio  batvi^  tha  mK!±^  of  aircrafts  ready  for 


Mght  arKi  the  tctel  rwmoar  anranane.  une  oi  me  mawi  goai  m  *c»k9uu.!i  ly 
it  to  iTiaimaln  a  high  sarvloeabiUty  rate  while  meetmg  operafior»!  and  training 
fequirements.  This  is  a  con’^)lex  problem  tor  toe  aircraft  malntainers  since  aircrafts 
may  bre^  down  unexpec^sdiy  after  missions  making  ft  tffficuR  to  follow  a  preset 
acheduie.  We  propose  In  this  paper  a  three-step  approach  which  combines  an 
expert  system,  an  optimfaMlion  module  and  a  critiqua  module  to  assist  toe 
malntainers  and  operators  in  the  production  of  a  mission  schedule.  Our  approach 
first  prepares  an  Initial  schertole  using  an  optimization  model.  The  expert  system 
then  reviews  the  schedule  to  enforce  domain  specific  heuristics  based  w 
maintatows  arto  operators  er^rerience.  The  ache^lo  is  then  evaluated  by 
makitairrers  in  conjunction  with  a  crtoquo  module  whUto,  usirtg  machine  leamlrrg 

techniques,  wrfll  refine  toe  heuristics  used  by  the  expert  system.  Our  awprtjach  is 

currently  being  deveiopped  tor  a  F  -18  squadron  using  an  axpert  system  shen 
caUyt  ART-iM  and  an  operations  research  system  nmning  <m  a  PC.  Favorable 
results  were  obtakied  from  each  module  and  they  are  rrow  being  integra.ed  in  an 

application  running  in  the  Microsrtl  Wtodows  enviror^nerrL 


^  ot  AdBueiatntka.  Col^  MUilaire  Royri  de  Sdol-Je«n.  Rkhehio,  Quebec 


Introduction 

Over  the  put  Ifew  yean  abctift  have  iocieasin^y  emf^oyed  to{)hi«icated  Rdmctogy 
tlesigned  to  reduce  pilot  woilcload  nd  inqrove  efFecthnaess.  The  CF-18'a  heads-up  SsjAay  nd 
multiple  target  acqidsMon  systems  ate  examines  of  such  technology.  Aircrew  in  pardcular  have 
hum  the  intmrfurtfaiii  of  oo(P|mten  on  board.  Besides  fteehy  the  pilot  ftixn  lethous 
in  system  operations,  ocmputen  dso  provide  significant  decision  analysis  c^ghflity  in 
target  detraion.  identification  ami  cngai^mem  pncedmes.  They  malce  it  possitte  ibr  die  pilot  to 

conceimte  on  Sying  die  airctaft  and  »  better  manage  the  aiiciaft  tinder  vadota  scenarioe. 

WIdk  computer  tedhntdc^  is  employed  in  aircraft  systoos  as  decision  dth  ftar  aircrew,  it 
is  not  used  extensively  in  aviadon  squadrais  fiir  maiisananoe  managers.  One  area  dut  could 
substfiidally  fsofit  ftom  automsiao  is  that  of  drnaft  adiedulirig.  Setvice^dlity  of  a  ccoibat 

squadron  is  the  rjfiio  between  the  number  (rf  aircrafts  ready  fbr  flight  and  die  total  number  available. 

Tbis  vahre  tjurfng  die  day  as  some  aircraft  break  down  after  tnissioa  completion  and 

odwR  ate  released  by  maintenance  Aircraft  service^dliQr  is  ciidcal  to  opemioonal 

leacdness  and  yet,  at  presms,  there  is  no  nutomated  decision  support  aid  avdlalde  Car  diose  who 
flptratnna  ind  maintemnce  Stdie  sqiiadion  levcL 

yhwtwHnj  i>  central  to  nMvtoahfliry.  When  de^Sngwhidimls^ms  will  be  flown 
mtd  when,  managers  must  careMy  bsdaace  operutooal,  ttdtaiag,  and  matereoance  leqdrements. 
Overflying  availaUe  aircraft  will  reduce  aetvioetiiQity  as  wiD  flying  oatain  high  fiuigue  missioas. 
Presendy  managers  base  their  pta>u^*g  on  diarts  0.e.  tail  omnL'tr  vs  dme  to  Inspection)  as  weQ  as 

personal  experience  and  knowled^  The  sdudons  imideiiasnted  are  not  dways  qxinial  given  the 
ooncfitions  and  aidiou^  opmadonal  requirements  ate  often  met,  dicy  aie  adieivM  at  die  omt  of 
undue,  painstaking  efEwt, 

Wf  rii-vrinptAig  a  Deddoo  Support  Systan/Expeit  System  (DSS/ES)  to  aid 

managers  at  the  base  and  die  sqnadton  levd  in  opdinuing  aircraft  serviceability,  the 
PSS/F-S  will  cprehine  a  ffath^tnarirai  modd  of  the  optimizazion  tfaemy  with  an  eiqiett  system 
using  domain  knowledge  about  managemeto.  ft  wm  give  dre  user  an  insight  imo  the  ooosetptences 
of  a  given  schedule.  Maddne  katning  tedudques  will  dso  be  used  to  make  the 

synem  adqpdve  to  its  enviroament 

frfr.  Our  is  the  fiist  one  to  combine  concepts  fiom  Operatiaas  Reseaidi  and  Eq»i 

Systems  whidi  may  sdve  many  problems  encouruered  so  ftff  with  those  qiproaches. 

This  paper  is  organized  as  fellows:  first,  we  will  imroduce  Desdsioa  Support  Systems 

concepts.  Next,  we  will  dww  die  architecture  of  DSS  F18.  Then,  we  win  present  die  dnee  prindpal 
modules  of  our  system  and  complete  widi  an  example  based  on  leal-woid  data. 

Decision  Support  Systems 

A  support  system  (DSS)  collides  the  intellectual  icsources  of  individoais,  in  our 

case  the  operations  and  maintenance  managers,  with  the  capaWlides  of  the  computer  to  imi»ove  the 

quality  of  dedaoRS.  The  fourmajorcharacteiistics  of  DSS  arc  the  following: 


DSS  incorporate  both  data  and  nioddi.  The  dedsion  making  procesa  rdiea  on  ^want 
data  to  be  available  to  guide  the  manager  in  the  sdecdon  of  the  best  ahemadve.^  **'*.®®^ 
tools  designed  to  evaluate  and  mwipiilmie  the  data  in  onto  to  create  and  te»  hypotheses.  For 
t  modd  can  be  a  Waea  progtmn,  a  statistical  mtdtod.  a  scientific  computaiOT  or  an 

eapett  system.  The  K5S  a«l  nonaaUy  ptovWc  a  user-fdendly  ftcnt  end  through  which  the  user 

will  can  the  qtpropdate  modd  when  required.  This  fipcmt  end  contains  a  coouotler  program  » 
—ttay  jh*  *schangf  th*  data  and  the  syndtioniration.bdween  the  models.  Hgure  1  diows  the 
aidiitecture  of  a  DSS. 


PSS  are  dfdg"*d  to  aMfat  managera  In  flidr  decMon  processes  humstnictared  tasits. 

Stnemred  <»**■*  dways  invdvc  flte  sane  aetptence  d  steps  in  its  flilfillment  nod  allows  no 
deviations.  Ftor  exan^  processhtg  w«k  otdeis  or  tracking  aircraft  flying  hours  are  figured 
tides.  Smictared  tasks  are  best  handled  using  TVansaetkm  Processing  Systems  (TPS)  or 
Management  tofoimalioo  Systems  (MIS).  On  the  other  hand,  iiwtniciiiredm^  to  n«(b^ 
fixed  sequence  (tfsreps.  Examples  rf  sm*  tasks  are  (darning,  sdwftiling  and  forecasting.  The 

number  and  order  of  steps  diey  invdved  are  left  to  the  discretion  of  Ac  user. 

DSS  aqtport,  rafter  than  replace,  mamgerial  jadgenrent  tWike  other  types  of 
wstems,  the  user  is  drivii«  a  DSS  and  not  the  other  way  around.  The  tfialogne  between  the  sy^ 
atd  the  user  must  always  be  lead  by  the  latter.  TWsciitetoiscnicialftjrtheaccqxanceof  aDSS 
by  mnagexs  tt>  whi^  te  system  is  tsrgested. 

The  objective  of  WS  Is  to  Improve  the  effcctivenca  of  the  deddons,  not  the  effidency 

wiA  which  decisions  are  bdng  made.  The  quality  of  the  decisions  made,  and  not  neewsarily  the 
speed  a  wtddi  it  is  obtained,  is  the  ultimate  of  usii^  a  MS.  The  quality  of  a  decisioo  will  w 

tawwed  if  ft  is  based  on  a  large  number  of  dau  and  if  a  la^c  number  of  alternatives  are  evaluated. 

DSS  provide  both  the  access  to  the  data  and  the  models  which  makes  tha  possible. 
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The  Architecture  of  DSS  FIS 

llie  aidntectuit  of  DSS  F18  i^kowo  in  figure  2  is  composed  of  six  models  grouped  in  three 
cat^oiies: 

The  Mathematical  models.  TUs  eat^joty  oontsins  the  scheduling  nd  the  assignment 
modeL  Those  two  models  are  based  on  Operations  Research  md  they  sre  designed  to  cmnpute  the 
best  ahemative  according  to  mathematical  (quantifiable)  constraino. 

The  Expert/Critiqire  models.  The  fim  model,  called  the  schedufing  expen  modd. 
reviews  sciredules  in  cotter  tt>  enfince  nan-tpi^ttifiable  constraints.  This  eqten  system  uses  a 
icnowtedge*base  includes  tides  used  by  expeiiotced  operatioas  and  maintenance  officers. 
The  second  model,  called  the  critique  model,  mmiitois  the  sdiedufit^  process  in  order  to  refine  the 
knowledge-base  based  on  usd's  preferences. 

The  Staristfcal/Ehrta  Managemdit  Sy^em  modds.  The  Data  Management  System. 

I  expected  to  be  in  i»oduction  in  late  1992,  rectxds  maintenance  data  on  every  locatimi  wbm  the 
F18  is  in  use.  The  nudniienance  data  will  be  used  1^  tibe  statistical  modd  to  compute  values 
required  by  lire  sdreduling  and  the  assignment  models  such  ss  the  probability  of  aitetaft  breakdown 
and  flying  hours  infonnarion. 


The  system  is  managed  by  a  contioDer  program  which  uses  regular  object-oriented  code 
prvi  a  role  based  expert  system.  The  user  interface  uses  state-of-tbe-ait  graphics  and  mouse-driven 
dialogs  to  ensure  user  acceptance  and  cooperarim.  The  input  and  output  management  modules 
ensures  that  the  data  is  pieseiued  in  familiar  fimms  to  the  user  (e.g.  calendar  pages  fire  scheduling, 
cdor  graphics  for  stagger  charts,  aircraft  picture  fire  exercise  configuration,  etc.) 
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The  Mathematical  Model 

The  nuthematical  module  comains  die  operations  research  processes  that  will  oondua 
stochastic  scheduling  anJ  assignment  of  CF-18  aiicraft.  Ihe  scheduling  subcomponent  receives 
user  iqwt  in  the  fonn  of  v^peradonal  constraints  and  produces  an  initial  schedule.  Based  on  this 
sdiedttle  as  well  as  maiutenatioe  requiremems.  the  assignment  submodule  win  pair  each  mission 
with  selected  aircraft  The  initial  schedule  and  the  assignment  list  will  then  be  routed  to  the  expeit 
system  which,  if  need  be.  will  modUy  these  using  heurisdcs  devdoped  &om  the  opetaton  and 
maintainets’ expeiience. 

The  stochastic  sdsduling  proMem  can  be  defined  as  die  probleffl  at  finding  a  sei  d 
firesibie  patterns  in  (Mder  to  maximize  the  number  of  serviceaUe  aitaaft  snd  die  tmal  number 

ttf  missions  effected  during  a  given  time  firame.  WhQe  pursuing  this  objective  certain  user  ttefined 
operational  constraints  must  be  met  For  example,  given  missions  must  be  preformed  on 
predetermined  dates;  a  minimum  number  of  rerviceable  aircraft  are  lequireb  to  fly  certain  patterns; 
a  minimum  number  of  sorties  must  be  flown  in  a  spoiled  period,  etc.  For  its  part  die  aircraft 
assignmem  problem  is  oonceraed  with  optimizing  maintenance  operations,  ft  therefbre  involves 
minimizing  maintreiance  human  resources  while  maintaining  fiiU  fligltt  coverage  as  weD  as  meeting 
the  tfifferem  overhaul  and  maintenance  requirements  fbr  eadi  individual  CF'tS. 

Work  on  the  mathematical  module  has  focused  to  date  on  die  sdwduling  problem.  We  have 
devdopped  two  models  to  address  die  sdKdu&ng  proUem:  a  deterministic  one  «id  a  laochastic 
one.  bt  die  first  modd,  die  daily  eiqiected  damage  to  airciaft  is  viewed  as  being  soley  dqiendant  on 
the  ciiosen  flight  pattern.  In  die  second  modd,  the  rare  of  repair  b  s  dodiastic  process  rdated  to  die 
number  of  unserviceable  aircraft  and  the  pattern  used. 

A  deterministic  modd 

instead  of  considering  the  complete  distribution  of  damage  to  aircraft  acctmfing  to  die 
chosen  flight  pattern,  we  oonsidet  die  average  value.  A  flight  pattern  is  afixed  [dan  of  missions  to 
be  flown  in  a  day.  The  modd  is  dius  deterministic  and  it  was  ftumulated  as  a  mixed  integer  pro- 
gramming  modd  [6]: 


niax£,- navi  +  XX,- torfsi  (1) 

subject  to:  V/ V;  (2) 

Xy  ptmy-l  Vf  (3) 

Iiav{.iiavi.|-f^dhtgeyptni^*repi.t«0  Vi  (4) 

repi*4flnav|-2lyc6ngey  ptriiy)  ^  04  Vi  (5) 

XyhriPyPtmij-  tmisi^O  Vi  (6) 

Xj  ptmgSreq^  ViteAT  (7) 

npi^urep  V»‘  (8) 

nav|«i/ti  (9) 

ptmy  €  {0,1}  Vi  V;  (10) 

iiavi4»P|6  {0,14,..-}  Vi  (11) 
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where  the  constants  are: 


j ;  is  a  subscript  that  indicates  the  day, />  1, ...» m  where  m  is  the  eod  of  Oe  horizoo. 

/  is  a  subscript  d>at  rqnesents  the  patteni.y  <B  1. n. 

k:  is  a  subscript  that  indicates  die  ranking  of  die  operadonal  teqidretBem  widdn  the  set  of  user 
defined  operational  constraints  iT. 

X:  indicates  die  relative  importance  of  rnaxiniizing  tnissitns  widi  teqiea  10  sctviceabte  aircraft. 

:  is  d»y  tb  operadonnal  requiieineiit  ^wdfied  in  the  triotteL  An  operadoanal  tequiietii^  is 
die  number  of  times  a  pattern  must  be  flown. 

oiyiy:  is  die  total  number  of  missions  flown  ftn*  a  pattemy. 

ac^j :  iq;nesents  the  number  of  aircraft  lequixed  to  fly  a  pattern  j.  Thus  dds  is  the  maximum 
numoer  of  aircraft  flown  in  a  pattern. 

dbirgeyt  is  the  eiqpected  number  of  aircraft  damaged  after  flying  a  pattemy  in  day  1. 

imficrues  the  percentage  ttf  aircraft  under  repair  dm  win  be  lemmed  to  service  the  ftdlowing 

me :  is  die  total  number  of  aircraft  (serviceable  and  non-serviceable)  at  the  squadnm. 

:  fixes  the  upper  bound  of  die  rmmber  of  aircraft  repaired  on  a  certain  day  i. 

M :  is  the  initial  number  serviceable  ahciaft  on  day  1. 
and  die  variables: 

aav| :  indicates  the  number  of  Q'-IS  available  on  a  given  day  L  The  oiigin  is  day  1  (navi)  at 
widdi  the  number  of  available  aircraft  is  known. 

tnd^ :  iqnesents  the  number  (rf  inissk»s  flown  on  a  given  day  f. 

plmy :  stands  panemy  on  day  i.  ft  takes  on  a  value  (^0  or  1;  0  vdien  the  pattern  is  not  used 
on  dm  day  and  1  when  it  is. 

npi :  is  the  number  of  aircraft  repaired  on  day  t 

The  equations  in  the  model  may  be  interpreted  as  ftillows: 

Equation  (1)  represents  the  objective  Le.  to  maximize  die  number  of  available  aircraft  and  the 
number  of  total  missions  for  each  day  within  the  horizon; 

Equation  (2)  itKiicates  dm  in  order  to  to  fly  a  daily  mission  pattern  on  a  given  day,  the  number 
rtf  available  aircraft  on  that  day  must  be  aipeiior  or  equal  to  the  number  of  aiicraft  required  for 
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thtt  pattern; 


Etpiatioii  (3)  states  that  only  one  pattern  will  be  used  on  each  day; 

Equathm  (4)  states  that  the  number  of  availatde  aircraft  on  a  jjven  day  is  etpal  to  the  numbnr 
of  aerviceabie  aircraft  on  the  previous  day  minus  the  expected  number  of  aircraft  damaged 
during  flight  plus  those  rqMdied  in  the  meamiffle; 

Equatkm  (5)  defines  the  number  of  aiiaaft  repaired  during  a  given  day  as  a  percentage  of  the 
aitcnft  diat  ate  unservkeaUe  at  the  beginning  of  diat  day  and  die  aircraft  thm  are  danaged 
during  the  day.  The  addition  of  OJ  to  the  resulting  number  serves  to  approximate  the  number  of 
aiiaaft  repaid  to  the  next  higher  number 

Equatkm  (<5)  states  diat  total  number  of  morions  flown  on  a  given  day  is  eipial  to  the  number 
of  missions  ^  the  pattern  flowiu 

E^wtfhm  (7)  specifies  that  a  given  mission  must  be  flown  at  least  a  user  defined  tnimber  of 
times; 

Equatkm  (S)  d^hes  an  iqpper  bound  on  the  number  of  aiicraft  diat  can  be  lepaiied  on  a  given 

’■  d^and., 

Equatkm  (9)  gives  die  number  of  akcraft  available  at  the  origin. 

.IMs  model  can  be  solved  by  a  branch  mid  bound  medicxL  but  die  oomputadon  time 
necessary  to  cdxain  optimal  results  on  a  realistic  problem  is  unacceptaWe  fw  an  interactive  system. 
Hence,  we  have  explcrited  the  particular  structure  of  this  model  and  solved  it  by  a  decomposition 
appiD^  If  the  {KOgram  is  tdaxed  by  omitding  the  operational  constrainis  (8).  the  resulting  model 
can  be  ftxmulaied  as  a  shortest  path  ptOUem.  Based  on  this,  an  algcnidim  using  a  dynamic 
pngramming  apptoacdi  [7]  was  developped  to  scdve  the  idaxed  problem  in  real  lime.  The  recursive 
fimctkmusedis 

V,  *  in«{vi^  C/) + nav,  +  Atnds,  (»} 

udieie:  rqtwesents  a  feasiUc  state  at  stage /+ 1  given  the  pattemy  chosen  at  stage  i. 

The  consnaims  are  taken  imo  accoum  by  an  implicit  enumeration  over  the 

set  defined  by  these  constraints.  Under  the  terms  of  the  precec^  deterministic  m^  the 
objective  was  unamlnguousiy  qiecified  by  fixing  values  for  die  dedsion  variables.  Preliminary 
rf<iiirg  give  us  interesting  insights  on  the  behaviour  of  the  system. 


A  stochastic  iiKMlel 


c»ari«rirai  aiulysis  conducted  parallely  on  CF-18  flight  data  revealed  that  die  rate  of  repair 
is  more  likely  a  stochastic  process  related  to  die  number  of  unseiviceable  aircraft,  and  the  pattern 
used.  For  sunfdicity,  let  us  define: 
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3^•inav^,ptm^,rep^,tmis^) 

mi 

5*:  is  die  vecwr  of  ife  picbaUHty  that  given  s  number  of  serviceaUe  aircraft  far  the  day 

and  a  partem  there  win  be  a  certain  number  of  misMon-csqable  aircraft  on  the  next 

day.  A  discrete  distiibutioa  with  m(/;  values  to  parremy  la  assumed. 

Hien  die  model  can  be  written  as: 

max^^  £{nflVj+A»iiy,+Ci  (*'.$*)} 

T^jr*^+lvV  «{'•'} 

widi(J  *0  forf»«+i,«+2,.... 

udiere  corresponds  to  constraints  (2  -  3),  (6)  and  (8  - 11)  to  a  given  i  md  7^'^  and  ^  are  the 
KnHng  matrirM  Corresponding  to  die  munber  of  aircraft  available  after  the  rarKkna  variable  y  is 
observed  These  constraints  replaced  the  constraints  (4  -  5).  This  model  is  an  n-stage  stochastic 
program  (8]  with  fixed  recourse.  However,  adding  the  t^ierational  constraints  (7)  breaks  the  block 
aDgikar  stnictuit  of  tMs  {Kogram. 

As  to  the  previous  model,  we  have  exploited  the  structure  of  dds  model  and  sdved  it  Iqr  a 
decompo^on  iqiproMh.  The  subprogram  is  .nill  a  shortest  path  prOMem  (the  number  of  nodes  ai^ 
arcs  but  remains  iractrd^).  Again  we  stdvc  the  relaxed  program  by  dynamic 

pfpgraisniing  aad  the  recursive  function  used  is  now: 


«  max]  naVi +2tiniSt(y)) 

l-O) 

Again  the  operational  constraijus  are  taken  into  account  by  an  implicit  enumeration  over 
the  set  Research  in  the  mathematical  module  will  now  shift  towards  the  develogment  of 

methods  to  strive  the  scheduling  proWem  with  more  general  operational  constraints  and  to  resolve 
the  airctaft  assignment  problem. 

The  Statistical  Model 

The  model  is  based  on  the  assumption  of  daily  patterns  in  the  flying  and 

repair  operations.  These  patterns  arc  identified  by  a  statistical  analysis  of  the  records  in  the  dam 
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aunagemem  system  (DMS).  It  is  a  ocnditucMS  process  »  admire  tbe  peoem  cfaan^  arising  lltom 
modifictiions  to  sudi  aspects  as  stptadron  Rde,  fleet  strength  or  training  of  groundcrew  and  aiictew. 

Ihe  tetois  creating  a  putent  an: 

1.  Tbidnimberof  aifcriftavaildile  atthe  stanofad^. 

1  Tirod  mmber  (tf  missia^ 

3.  The  missioa  types  flown  in  a  day. 

A  probability  (fistiibittiaa  is  created  tqr  pattern  fbr  the  number  (d  dimft  vnseiviceable  on 
ibenestd^.  link  with  DMS  aDows  a  oomiinioustiiAeeping  of  die  pRdntbiUty  values.  The 
drily  nset^  raw  inputs  are  filtered  by  the  statistical  mo(^  to  keep  only  the  infbimatlon  <rf  interest 
lor  proinddlity  estimations.  If  an  t^dated  probability  exceeds  by  a  set  margin  the  previoas  value, 
the  probability  disttibution  mathematical  exptessioo  is  leesdmared  for  aQ  cmT  this 

psiim  and  dre  dynamic  pR^jOam  mmiix  of  dam  conected  accordingly. 

The  present  model  is  made  of  20  patterns  occuRing  5  to  2S  times  each  over  die  year 
at  433  Squadron,  CFB  BagotviUe.  The  probatdUtytfistribatiaalbreaidi  pattern  is  esimated  bared 
«n  the  least  square  fitting  method.  Tim  obsetved  probabilities  fitted  are  dm  number  <rf  occurrences 
for  X  aimaft  omerviceable  CO  the  next  day  Ibr  a  ^ven  patton  over  the  total  number  (tf  occanenoes 
to  the  fixed  values  trf  the  diree&ctois  making  this  pattern.  The  estimated  pnobaUlides  are  sent  to 
to  dynamic  prograinming  ihodri  along  wto  dm  infixmatiaa  about  to  fhetots  making  the  pmtem. 
The  estimation  of  to  pntoMlities  it  presemly  based  on  one  y^  of  operations  and  will  be 
extended  to  two  years  wme  dm  DMS  supports  such  a  databank.  A  seasonality  factor  will  thoi  be 
irxroduccd  M  account  for  block  leaves,  severe  winter  weather  ai^  intensive  exercise  periods. 

After  a  rignificani  time  of  opendco  of  to  dedsioo  support  syriem,  to  mqmt  system 
flwdel  will  analyze  to  choices  of  pattern  to  ppdmri  sniutioa  The  pattern  barely  used  will  be 
hfghiighmd.  The  users  wQl  be  intomed  and  ariced  to  insert  new  patterns  If  desired,  baposiiive 
ciae,  to  starisiical  model  is  tiiggered  tote  new  ptttems,  dosing  dm  loop  of  dm  system. 

The  Expert/Ciltique  Model 

The  puipose  of  dm  Erqmtt/Critiqae  Idbdd  is  to: 

t.  Consider  human  factors  in  the  sdmchiKng  process, 

2.  Feilbmi  sensidvi^  anriysis  on  to  rnstfaemsdc^ 

3.  Mfloitor  dm  pertommee  (rf  dm  mathematical  model,  and, 

4.  htaiiior  user's  response  to  proposed  alternatives. 

Human  factms,  such  as  technician  wmkload  and  morale,  are  sometimes  difficult  to 
reconcile  with  operational  requirements.  Utitotun^y,  human  faoors  are  txaHjiiamifiable  and 
cannot  be  integrated  in  dm  mathematical  model  Successful  managen  uae  thdr  experience  to 
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evaluate  the  impact  of  aircraft  missions  schedule  on  tbe  pec^le  and  tbe  mganizatian.  They  use 
their  experience  to  detennine  which  modification  can  turn  a  weak  sdhedule  fttxn  the  human  fiutor 
point  of  vue  into  a  better  one. 

Expen  sjrstems  [9]  are  the  best  tedmdogy  avsdlaWe  today  to  modd  managen  experience. 
The  heuristics  (or  niles  of  thumb)  they  use  can  be  translated  into  psitems*actians  (production)  rales 
where  patterns  iqnesent  sdiedule  prations  and  actians  rqtresent  mndifigarinn  to  the  idtfrfuie  For 
instance,  if  a  rule  recognizes  that  a  cenain  pan  of  die  sch^ule  win  require  a  great  deal  of  oveniffle, 
this  pan  can  be  re-adjusted  hy  >  nile  that  reduces  oveitime  udiile  respecting  opefati^nd 
mptimrents. 

Sensitivity  analysis  is  the  process  of  ad.^tsting  the  settMtive  parameters  0.e.  dxxre  that 
cannot  be  changed  with^  changii^  the  ojximal  sdudtm).  The  purpose  can  be  to  idnsi^  the  best 
iradeoir  between  two  ctmfiicting  goals  suA  as,  ftw  instance,  aircrsft  n5!aai<wa  sad  serviceability,  or 
to  mocfiiy  certain  results  of  the  modd  without  changing  tbe  t^^mality  ttf  the  sdutimi.  b  sane 
cases,  the  sensitivity  analysis  will  be  petibimed  by  tits  e:^)en  system  on  Its  own.  In  otirer  cases,  it 
win  be  perfbnned  by  the  urer  with  the  assistance  of  the  exji^rt  system. 

There  is  a  major  benefit  in  having  the  expen  system  assist  the  user  in  conducting  sensitivity 
andysis.  Tbe  benefit  is  that  tire  user  win  be  aMe  to  det^  aral  diange  some  puameten  witisott 
ever  coming  into  contact  with  tire  actual  mathematical  modd.  TTre  leanrfng  eninpfirB»tw  of  tire 
ExpertA!!ritic|ue  Module  win  ffionita’ tire  sensitivity  analysis  action  initiated  by  tire  user  in  onkr  to 
ng^st  siinilar  actiois  in  fiituie  scenarios.  The  omcome  tire  soisitivity  analysis  actions  win 
determiire  how  relevant  they  are  and  if  drey  are  wottii  rsnembering. 

The  user  of  DSS  FIS  is  fiee  to  impose  any  constraints  (called  user-imposed  ooistiaints)  to 
the  modd  beloe  scheduling  is  perfoimed.  The  expert  system  wiH  motitor  tire  impaa  of  those 
user-imposed  consttaints  on  tbe  peifbnnanoe  of  tbe  sdreduling  modd  tnd  on  the  qoali^  of  tire 
resuhing  sdredale.  Tbe  objective  is  to  provide  ipiidance  to  tire  user  in  tire  chdce  of  these 
axmraims  by  providing  a  preview  ctf  tire  bapaa  on  tire  scheduling  process  sod  oo  tire 
Guidance  itrehides  both  encouraging  and  discoataging  tire  choice  (rf  a  user-in^CBed  oonstiainL 

b  several  cases,  user  win  be  presotted  more  than  one  alternative  br  a  The 

Etqpei^Critique  Modd  wOl  monitor  tdiich  alternative  is  peefesed  by  tire  user  and  win  evaluate  tire 
outcome  of  tire  alternative  ftre  tire  scenario  usbg  user  feedback  and  data  fiom  DMS.  When  a 
dmiiar  sonarb  is  presented  to  the  user,  tire  Etqreit^ritiqae  Modd  wiU  intfic^  wbidi  ahemative 
is  tire  most  likdy  to  payoff  and  wfaiefa  altenretive  is  to  be  avoided.  The  expert  system  wOl  provide 
jostiScatiais  ftre  its  lecommendatinm  and  the  user  win  retab  tire  nirimaia  leqpcnsibin^  for  tire 

Example 

Testing  was  conducted  on  both  deterministic  and  stochastic  modds  udn^  fictitious  data 
resemUbg  real-life  situadons.  To  Ulustrate  tbe  DSS-F18  concept,  we  limit  oursdve  to  an  wrampi<» 
usmg  tire  detenninistic  model  A  simple  scenario  that  meets  tire  ftdlowbg  aiteria  is  chosen: 


tire  envisaged  horizon  was  10  days; 


•  dicnft  effected  three  series  of  soities  per  dty; 

•  psttons  with  12  to  18  softies  per  day  were  retained; 

•  waves  ot  2  sirciaft  were  used  te  imeitiqirioQ  nw,  4  tot  tit  cwfthtt 
■UBioeiiveTs^nd  6  fiy  tactical  missioas; 

•  the  maimetuMce  to  Bdsstopfhctor  was  arfaiiiarily  chosen  to  be  three  (^;  and, 

•  temaimenance  crew  eaa  repair  aitciaft  up  in  a  inaximum  of  three  atoaft  per  day. 

lUa  scenario  rqnesents  the  schednling  pRKess  used  by  a  atpiadron  ftir  an  hoiiz^  of  10 
days.  Id  dds  horizon,  die  squadroo  must  partidpatt  in  three  exerdses:  a  ground  atadc  exercise  00 
day  6,  an  air  refiieling  exerdse  on  day  7,  and  n  air  defafvy  exercise  on  day  8.  An  addidcnnal 
constraint  &r  die  squadron  is  that  twdve  air  missions  have  to  be  Sown  at  least  once 
outside  t|^egmn±»  poiod. 

Ihble  1  shows  that  for  dds  scenario,  IS  patterns  containing  inierc^it,  tactical,  or  air  combat 
manoenver  miasioos  with  12  to  24  aordes  were  hqxit  imo  die  model  The  exercises  selected 
ootrespood  to  panon  8  (ground  attadO,pattan  IS  (air  refohng)  and  pattern  4  (air  (HEnce).  Ifote 
that  the  special  request  for  pattern  4  and  the  air  defence  exerdse. 


Table  1:  IiqMt  data  for  the  deterministic  example 


Hgure  3  inesents  the  (Balog  screen  used  to  enter  the  scenaria  lUs  screen  rqnesems  a 
month  calendar  where  the  user  uses  a  mouse  to  drag  icons  representiiig  exetdses  to  specific 
Rir  example,  the  user  insetted  the  icon  for  ground  attach  on  the  17dL  The  user  enters  fixed 
constraitas  by  douUe-dicidng  on  a  iqiecific  date  and  the  munber  of  missions  fiir  the  day.  When  the 
dates  icpreaadng  the  horizon  ate  selected,  the  user  elides  on  the  button  Seheriiii^  on  the  bottom 


left  of  the  scRca  to  caU  the  madiematicai  nuxSd  whkdi  wiQ  prodoce  die  opdsiial  scfaedsle. 


Ihe  results  for  du  opdtnal  schedule  are  presented  in  table  2.  We  otminted  that  in  the  last 
days,  once  the  incxftd  has  satisfied  all  oonstr^sts.  k  fixaises  on  inaxiin!zi.iS  missicim  to  the 
of  serviceable  aircraft.  This  a  decTcaoe  in  servicea!^  ahoaft  over  the  last  few 
days.  TUs  is  called  end  of  period  tffea  and  cten  be  oarected  by  extemftng  the  hodaon  beyond  the 

user's  request  OT  by  intrcKhicing  a  salvage  vahte  in  dtedr^oivefimctian.  . 


Table  2:  Results  for  the  deterministic  scenario 


Hgore  4  shows  the  screen  (fi^layed  by  the  system  after  the  expert  system  analysed  the 
t^^athwnarifai  model  soludtHi  in  order  to  account  for  qualitative  factors.  TUs  screen  shows  the 
solution  and  smne  recommendations  tbr  its  imptementation.  The  total  number  of  ntis.s3ons  to  8y 
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each  day  is  (Sqdayed  with  the  iidtial  ccnsmditt  tii^iSClbi^ 
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Hguie  4:  The  sobidoQ  scteen  of  F18 


CiNMdnding  Rraiaiiui  and  Further  Research 


iteaeandi  and  deveh^Buitt  oontinne  on  each  module  aid  on  the  fill!  itB^ndaQ  of  diem. 
For  the  matemaUcd  modnle.  we  are  ptesend^  woddng  on  the  geneializadon  (tf  the  decoB^xtsitiaa 

Hymfh  frir  rairing  twn  arrrmiTtt  differed  tvpcs  of  oociational  cTOStraints.  The  asUgomem  modd 
iscanemfy  nnderdevelopmeaaadhasyettoheintt^atedintfaesysteiiL  We  ate  also  conrideiing 
■1  frr"w4»  ytf^  OQ  siodtastir  piocess  with  rn««t^  pertaihed  tiandtiQa  matrix.  The  sariiBi,<;ai 
wneM  win  fntpinre  tfae  piKcaiifliiiy  of  seasonality  nd  die  oaounoEiaHty  of  patterns  prohaldlity 
^twiMtiow  between  F18  fi^iter  squadions  aooss  Canada.  Also  the  conceprion  of  an  automatic 
pn^pan  lor  sndyzing  die  qpcoming  data  fins  die  datahase  DMS  win  be  aifaessed.  hi  the 
fspettfc66cix  a  major  kocnriedge  etqsiiieering  exenase  has  to  take  pbce  to  oeate  and 

if«K<«ai>^wtnfii|iw»!igit  the  experience  and  knoadedge  of  opetadoos  and  maiiaeiianceinaBaiBeis. 
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AFtUCATIONS  OFSXPESTS  SYSTEMS  INDND 


A  RRST  GLANCE  AT  REAL-TIME  KMOWLEGEBASE  SYSTEMS  FOR  THE 

THREAT  EVALUATION  AND  WEAPON  ASSIGNMENT  PROCESS 

R.Ceu1in9' 

Atetrtct 

T»»  tnti-shlp  missile  which  Is  launched  from  a  submarine,  surface  ship  or 
ak  platform  can  be  a  serious  threat  to  Canadian  shipping.  The  Threat  Evaluation 
and  Weapon  Assignment  (TEWA)  process  is  a  very  Important  ftjrwtion  In  a 
warsh^’s  CommarKl  and  Contixrt  sy^em  sfrwe  » ra^  the  air  threats  which  are 
detected  by  ttie  automatic  detection  and  tracktog  process  and  assigns  a  hardkill 
or  softklll  weapon  to  these  ranked  threats.  . 

'  A  krwwiedge-base  TEWA  has  been  bulk  In  SMALLTALKAIUMBUE  to  do 

_ ivaluatkxi  and  Weapon  Assignment  for  a  single  stationary  TRUMPlike  ship 

attacked  by  anti-ship  missiles.  The  TOUMPlike  rrfiip  Is  equipped  with  SM-2 
missiles,  a  medium  calibre  gun,  a  close-in  weapon  system  and  surtable  softkUl 
weapon  systems  T^;j)aper  will  descrtoosthe  knowledge-base  TEWA  for  the 
TRUMPNce  ^ip  arwl  glw  results  of  Its  performance  In  multi-threat  sc^arios.  kwilf 
Afar,  descrfoejnirrent  efforts  to  have  the  TEWA  assign  hardkill/softkill  weapons  to 
^K-ship  mlsdles  equipped  with  radar,  infrared  or  ARM  (anti-radiation  missile) 
seeker  heads  from  a  ship  which  can  manoeuvre. 

;  FinaWy,  the  author  will  presents  list  of  real  time  requirements  that  the 
knowledge-base  must  satisfy  when  It  does  thr^t  evaluatirm  and  weapon 
assioiment  for  a  stogie  ship  to  a  self-defence  role.  HeJinll  describeSthe  problems 

to  bo  overcome  to  building  a  real-time  knowledgo-base  TEWA  for  Canadian  ships.^ 

He  win  also  give  qualitative  descr^jtions  of  research  efforts  to  find  solutions  to 
these  problems. 


‘Defence  Scientist,  Defence  Resewch  Estibiisfamene  Vakartier,  Quebec  Cky 


INTRODUCTION 


The  defence  of  a  fiigate  or  destroyer  from  an  attack  of  anti-ship  missiles  launched 
from  submarines,  enemy  surface  ships  or  air  platforms  constitutes  a  very  serious  problem 
to  the  dup  designer  and  to  the  design  of  specific  systems  and  software  making  up  its  anti- 
air  warfare  combat  system.  The  problem  is  a  real-time  problem  since  the  threats  are 
travelliug  at  very  high  speeds  thus  leaving  tite  ship  only  a  few  seconds  to  do  the  Threat 
Evaluation  and  Weapon  Assignment  and  fire  weapons  at  the  threats  to  destroy  them.  It 
became  evident  that  a  fully  automatic,  computerized  system  was  essential  to  fulfil  this  real¬ 
time  lequiranenL  There  was  also  a  need  to  study  the  methods  involved  in  ranking  the  air 
tiueats  at  each  second  of  an  air  attack  and  a  need  to  study  the  decision-making  process  for 

assigning  the  most  suitable  hardkill/softkill  weapons  to  these  threats. 

An  approach  using  knowledge-base  systems  has  been  adopted  to  study  the  TEWA 
process.  The  air  defence  functions  involved  in  the  process  were  studied  and  the  reasoning 
methods  from  artificial  intelligence  were  associated  with  possible  applications  of  the  air 
defence  probleia  The  outcome  of  this  knowledge  review  process  was  a  list  of  areas  in  ship 
air  defence  where  artificial  intelligence  methods  could  be  applied.  The  design  for  the 
knowledge-base  system  was  based  on  a  five  function  battle  management  process. 
Originally,  it  was  perceived  that  a  six  function  battle  management  plan  would  be  sufficient 
to  model  the  defensive  reactions  of  the  ship  including  those  involving  weapons  and 
sensors.  Since  this  study  only  involves  reactions  involving  weapons,  the  sixth  function  that 
selects  between  reactions  involving  weapons  and  those  involving  only  sensors  was 
removed.  In  order  to  test  and  analyze  the  decisions  made  by  the  knowledge-base  system,  a 
framework  environment  called  a  TEWA  simulator  was  created  in  an  object-oriented 
programming  language.  The  final  arrangement  for  testing  the  knowledge-base  system 
consisted  of  a  TEWA  track  generator  which  generated  air  tracks  for  prescribed  threats 
attacking  the  ship,  and  a  TEWA  simulator  which  contained  objects  representing  all  the 
important  elements  of  the  ship's  AAW  combat  system  (e.g.  fire-control  radar,  missile 
launching  system,  close-in  weapon  system,  etc)  and  representing  the  external  objects  of  the 
simulation  (ship  platform,  air  threat,  and  missile).  The  knowledge-base  system  was  tested 
by  running  the  TEWA  track  generator  first  to  generate  air  tracks  and  then  submitting  these 
tracks  to  the  simulator.  The  knowledge-base  system  ranked  the  tracks  according  to  its  rules 
and  then  produced  weapon  assignments  which  caused  the  state  of  objects  in  the  simulator 
to  change  (e.g.  the  missile  launcher  goes  from  a  loaded  state  to  a  firing  state).  The  threat 
rankings,  die  weapon  assignments  and  the  changes  of  state  of  objects  in  the  simulator  were 
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ita»ded  b  a  report  generator  produced  by  the  TEWA  sirnulaiOT  prognun. 

BACKGROUND 

Tire  Canadian  Forces  have  a  lequiremem  »  protect  dieir  warships  and  incrchantmen 

fton  air  threats  (aircraft  and  and-ship  missiles).  Tlieir  warships  should,  therefore,  be  able 
to  ^fend  themselves  in  a  self-defence  role  and  protect  convoys  of  merchantmen  in  an  area 
^fence  role.  It  is  essential  fw  the  warship  to  devclq?  a  complete  picture  of  tite  tac^al 
around  it  in  preparation  to  ranking  d»e  tiueats  and  assigning  weapons  to  them. 
Artificial  intelligerree  has  already  been  successfully  applied  to  the  tactical  situation 
evaluation  level  multi-sensor  data  fusion  for  a  convoy  of  ships  having  different 
functkms,  see  references  [11  to  [5]. 

it  is  known  that  knowledge-base  systems  can  be  successfully  applied  to  four 
important  classes  of  problems :  diagnosis,  control,  simulation  and  design,  see  references 
(61  Md  (91  expert  systems  »  be  used  stwcessfully  was 

MYCIN,  an  expert  system  for  diagnosing  tite  presence  of  diseases  in  a  patient  and 
spedfying  tite  rem^y.  Some  current  diagnostic  expert  systems  use  Ideas  develqted  in 
MYCIN.  The  uncertainty  reasoning  used  in  the  knowledge-base  system  described  in  this 
article  is  based  on  ideas  coming  from  Mycin,  Therefore,  the  work  described  in  tills  article 
an  exploratwy  study  to  see  whetiier  artificial  intelligence  can  be  applied  to  the 
TEWA  function  of  an  AAW  ftigatc  or  destroyer. 

Recently,  a  real  time  knowledge-base  demonstrator  to  do  Threa  Evaluation  and 
Weapon  Assignment  has  been  set  up.  It  is  known  as  RRASSL  (Reactioi  Resource 
Allocation-Single  Ship  Level),  see  reference  [10],  and  it  automates  the  TEWA  process.  It 
die  atali^  to  recommend  the  optimum  combination  of  missiles,  guns,  jammers  and 

decoys  in  ortfcr  to  inaximire  tiieir  effectivencM  and  prevent  mutual  interference. 

The  US  Navy  has  software  packa^  using  expert  systems  to  perform  decision 
aids,  see  reference  (11].  CASES  (Capabilities  Assessment,  Simulation  and  Evaluation 
System)  supports  tite  analysis  of  naval  operations  con^nsing  combinations  of  ASW,  AAW 
and  strike  warfare.  CASES  also  incorporates  two  expert  systems  to  assist  planners  in 

setting  up  and  analyzing  different  warfare  scenarios. 

Reference  (12]  gives  an  account  of  a  Tactical  Situation  Evaluation  function  and 
Tactics  Planner  Oncluding  weapon  assignment)  for  fighter  aircraft.  The  fighter  aircraft  must 
ffyinitnr  thc  for  the  presence  of  hostile  aircraft  and  missiles  and  must  take  defensive 


4 


iliijtiiiitfiVfliW  iiii^&'i 


action  against  them.  The  AAW  frigate  or  destroyer  must  do  the  same  thing  but  it  is  at  a 
disadvantage  because  it  cannot  manoeuvre  as  rapidly  as  a  fighter  aircraft 

The  purpose  of  the  TEWA  knowledge-base  system  is  to  assess  the  feasibility  of 
implementing  a  ship’s  TEWA  function  using  Artificial  Intelligence  (AI)  technology.  To 
conserve  project  funds  while  focusing  on  TEWA  related  issues,  the  facility  has  been 

impleiMnted  with  die  following  assumptions  and  limitations : 

(a) Only  a  single  ship’s  TEWA  is  considered  and  no  other  warships  are  available; 

(b) Thc  ship  is  not  maneuvering; 

(c) All  threats,  sensors  and  weapons  are  modelled  at  die  lowest  level  of  fidelity  which  is 
consistent  with  achieving  the  objectives  of  this  project. 

(d) All  anti-ship  missile  threats  have  active  radar  homing  heads. 

Umitation  (a)  is  not  considered  to  be  too  serious,  since  an  AAW  simulator  is 
currently  being  developed  in  which  air  attacks  on  a  convoy  of  warships  will  be  simulated. 
The  convoy  of  warships  in  the  simulator  will  operate  under  a  distributed  architecture,  i.e., 
die  TEWA  of  each  ship  will  be  autonomous  and  will  be  a  copy  of  the  knowledge-base 
system  described  in  this  article.  Limitation  (c)  is  also  not  considered  to  be  serious  since  this 
project  is  a  TEWA  study  and  the  threat,  sensor  and  weapon  models  have  been  built  with 
sufficient  detail  to  provide  all  the  necessary  inputs  to  the  TEWA  and  to  deal  with  all  the 
outputs  from  TEWA.  Limitation  (b)  is  more  important  since  in  some  cases  a  ship  has  to 
clear  blind  arcs  through  rotation  before  being  able  to  use  missile  and  gun  systems  and  in 
many  cases  it  has  to  rotate  to  deploy  chaff  against  an  anti-ship  missile  threat  This 
deficiency  will  be  cwTccted  in  the  AAW  simulator  where  ship  maneuvers  will  be  simulated 
before  chaff  deployment  and  missile  firings  when  they  are  required.  Limitation  (d)  is 
considered  to  be  reasonably  serious  since  there  are  anti-ship  missiles  with  infrared  and  anti¬ 
radiation  missile  seeker  heads.  At  the  present  moment  work  is  ongoing  to  develop  an 
adequate  Target  Evaluation  function  for  these  tiireats  and  to  extend  the  resource  planning  of 
tills  article  to  these  threats. 

The  TEWA  process  itself  is  implemented  at  the  highest  level  of  fidelity  using  AI 
techniques,  consistent  with  the  availability  of  funds.  In  general,  the  TEWA  process  can 
generate  three  types  of  reactions  in  order  to  deal  with  a  given  situation  . 

(1)  Defeat  the  threat  through  the  use  of  hardkill  and  softkill  weapons; 

(2)  Improve  force  knowledge  through  sensor  cueing  or  special  processing; 

(3)  Improve  force  efficiency  through  suitable  force  ship  formations  and  task  allocations. 
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As  stated  in  the  introduction,  the  TEWA  Track  Generating  Process  is  separate  from  the 
TEWA  Simulator  process.  The  sensor  models  used  to  sense  the  threats  arc  relatively 
simple.  Consequently,  d»e  TEWA  function  is  n«  able  to  cue  sensors  to  improve  force 
knowledge.  Also,  because  die  facility  considers  only  a  single  wanhip  which  cannot 
manoeuvre,  there  are  no  other  force  resources  to  be  accessed  in  time  of  need. 
Consequendy,  reacdons  of  type  2  and  3  are  not  supported  in  the  knowledge-base  system 
and  the  TEWA  deagn  presented  will  only  attenqit  to  generate  type  1  reacdons.  The  sens<»' 
cueing  opdon  is  a  technique  used  in  electronic  countermeasures  and  becomes  very 
important  in  studying  die  behaviour  of  the  Command  and  Control  system  in  electronic 
warfare. 

THE  KNOWLEDGE  REVIEW  PROCESS 

An  initial  knowledge  review  was  made  of  the  TEWA  process  to  facilitate  the  choice 
of  knowledge-base  shell  and  the  simuladon  environment  in  which  it  would  be  tested.  After 
doing  die  study,  it  was  evident  that  the  following  ardflcial  intelligence  funedons  were 
required  for  the  study.  These  funedons  are  described  in  the  following  paragraphs.  After 
examining  various  ardflcial  intelligence  shells,  the  shell  HUMBLE  was  chosen  because  it 
integrates  easily  into  a  SMALLTALK  environment  and  was  found  to  be  one  of  the  best 
shells  for  supplying  the  funcdonality  required  fx  our  study  of  TEWA  involving  and-siiip 
ndsdles. 

bi  die  inidal  analysis  of  the  TEWA  problem,  forward  and  backward  chaining  were 
b(Kh  given  emphasis  since  their  use  separately  and  in  combinadon  has  become  standard  in 
knowledge-base  applicadons.  Reference  [13]  points  out  that  backward  chaining  is  often 
more  efficient  and  rapid  than  forward  chaining  because  given  ai  objeedve  only  those  rules 
are  fired  which  produce  intermediate  values  leading  to  an  evaluadon  of  the  objeedve, 
whereas  in  forward  chaining  rules  are  often  fired  to  produce  intermediate  values  which  are 
not  used  to  evaluate  the  objeedve.  This  was  found  to  be  true  in  the  design  of  the  TEWA 
knowledge-base. 

There  is  an  important  technique  in  knowledge-base  systems  called  non-monotonic 
reasoning.  This  is  essendally  making  a  guess  (default  value)  in  the  absence  of  facts  and 
being  able  to  clean  out  default-based  inferences  when  a  contradictory  fact  arrives.  Non¬ 
monotonic  reasoning  was  inidally  identified  as  a  necessary  technique  in  connection  with 
determining  the  target  of  an  and-ship  missile.  After  building  the  target  evaluadon  function 
diis  knowledge-base  system,  it  was  realized  that  die  estimates  of  Idnemadc  parameters 
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would  indicate  that  the  target  was  nearing  the  ship  in  spite  of  sensor  eirors  and  hence  non- 
montMonic  reasoning  was  not  required  in  diis  modelling  of  an  attack  by  and-ship  missiles. 

A  requirement  has  also  been  idendfled  for  the  compact  handling  of  muldple 
confidence  futon,  and  muldple  confidence  factor  combinadon  paradigms.  Incoming  data 
to  TEWA  frtHn  sensors  is  usually  prone  to  errors  and  therefore  confidence  factms  may  be 
assigned  to  the  sensor  measurements.  In  addidon,  the  knowledge>ba$e  ttray  assign 
confidence  factors  to  die  inferences  that  it  makes. 

Temporal  reasoning  has  a  potential  applicadon  in  the  threat  evaluadon  process.  It 
invtdves  time  intervals  and  logic  calculadons  applied  to  them.  The  threat  evaluadon  process 
will  use  temporal  reasoning  in  that  present  threat  ranking  values  will  depend  on  past  ones. 
Spatial  reasoning  has  a  potential  applicadon  in  engageability  calculadons.  When  a  hostile 
target  is  outside  the  engageability  envelope  of  a  weapon  system  a  projection  from  the 
current  trajeaory  is  required  to  see  when  and  where  it  enters  the  weapon's  engageability 
envelope. 

In  a  blackboard-organized  knowledge-base  system,  several  experts  co-operate  in 
the  problem  solving  under  the  supervision  of  a  controlling  expert  who  reasons  about  the 
efficiency  of  the  search  for  solutions.  A  shared  database  is  the  "blackboard”,  while  the 
control  nnodule  may  have  its  own  local  database  to  keep  track  of  the  evolving  solution  state. 
For  a  sin^e  ship  attacked  by  and-ship  missiles,  the  current  TEWA  design  involves  five  air 
defence  functions  which  send  information  to  a  central  TEWA  unit.  A  blackboard  structure 
is  tiierefore  a  natural  choice  for  this  formulation  of  the  problem  with  the  control  module 
being  the  central  TEWA  unit  and  the  inputs  coming  from  four  HUMBLE  knowledge-bases. 

The  tist  of  tracks  to  be  input  to  TEWA.  as  well  as  various  tables  of  probabilities  and 
sensor  errors,  weapon  characteristics  and  historical  (tenqwral)  representations  of  tracks  all 
point  to  the  need  for  very  flexible  data  structures  within  the  knowledge-base  system.  For 
this  TEWA  problem,  the  SMALLTALK  object  has  been  found  to  be  adequate  fen*  sttuing 
this  kind  of  knowledge. 

THE  TEWA  TRACK  GENERATOR 

The  TEWA  Track  Generator  code  creates  a  track  data  file  which  is  used  as  input  for 
the  TEWA  Simulator.  The  data  within  the  file  represents  typical  output  over  time  from  an 
automatic  track  management  system  of  a  ship  being  attacked  by  anti-ship  missiles.  The 
output  from  the  TEWA  Track  Generator  is  not  generated  in  real  time  and  it  is  the  author's 
opinion  that  the  error  in  track  attributes  coming  from  this  programme  is  about  two  to  three 
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times  smaller  than  Ae  attributes  of  operational  track  data.  The  overall  plan  for  the  TEWA 
Track  Generatm^  is  given  in  figure  1.  The  Operatw  configures  the  scenario  consisting  of 
inti-ship  missiles,  ship’s  sensor  suite  ami  environmental  conditions  by  submitting  the 

iqjpropriate  data  to  the  SMALLTALK  man  machine  interface.  The  target  tracks  generated 

are  fist  anti-ship  missiles  attacking  a  tingle  TRUMPlike  ship  equipped  witit  a  long  range 
radar,  a  medhim  range  radar,  an  electronic  suppoit  measure,  an  infrared  search  and  track 
device,  the  two  types  of  fire-control  radar  needed  to  iQuminatt  targets  for  tite  SM-2  system 
(Standard  Missile-2)  and  the  fire-control  radar  for  the  76  mm  gun.  There  are  four  fixed 
vertical  profiles  for  tite  anti-ship  missile  threats :  sea  tidmrrwr,  high  diver,  shallow  diver 
and  hybrid  diver.  In  the  interface,  the  user  specifies  the  number  of  threats,  tite  vertical 
profile  of  each  one,  the  attack  direction  and  he  must  choose  a  subset  of  the  sensors 
inentio«^  above.  The  target  track  generator  computes  an  interpolated  track  from  the  user 
suj^lied  waypoints  of  each  threat.  There  is  a  surveillance  radar  model  that  simulates  long 
and  medium  range  radar  detectitms,  a  passive  sensor  detection  tiKxlel  that  simulates  both 
IRST  and  ESM  deletions,  and  a  fire-control  radar  model  that  generates  fire-control  radar 
trades.  It  is  assumed  tiiat  tiie  fire-control  radar  must  be  operating  in  tracking  mode  for  tiie 
ESM  to  be  able  to  function.  If  the  fire-control  radar  is  illuminating,  the  ESM  must  be 
switched  off. 

The  data  fiom  the  surveillance  radar  and  passive  sensors  undergoes  dau  association, 
data  dnxelation  and  finally  sensor  fusion.  The  latter  is  performed  by  using  a  nanimum 
variance  technique  to  give  prefused  surveillance  tracks,  i.e.,  for  a  given  range  tiie  fused 
data  is  tiie  sensor  track  data  with  the  smallest  variance.  If  the  fire-control  radar  is 
Tiinmtnaring  Of  tracking  (ESM  is  switched  off  or  <m  respectively),  its  tracks  arc  fused  with 
tiie  survdllance  tracks  in  a  final  fution  stage. 

The  Higher  Order  Attributes  function  in  figure  1  uses  information  such  as  position, 
velod^,  acceleration,  and  ESM  mode  to  assign  an  identification  to  the  track,  (i.e.,  plane, 
anti-ship  missile  or  even  a  more  spedfic  identification  such  as  the  type  of  anti-ship  missile 
e.g.  Exocet).  At  the  present  moment,  none  of  the  methods  of  handling  uncertainty 
mentioned  in  reference  [4]  are  used  in  track  identification.  The  identification  of  each  threat 
is  supplied  at  each  data  record  where  ESM  data  is  available.  A  confidence  factor  is 
assoriatfd  with  the  identification  which  is  calculated  as  a  function  of  the  distance  between 
the  threat  and  the  ship. 
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THE  TEWA  SIMULATOR 

The  basic  design  of  the  knowledge-base  TEWA  is  given  in  figure  2.  The  goal  of  the 
TEWA  function  is  to  assess  the  prevailing  situation  and  make  a  command  decision 
regarding  the  use  of  hardkill  and  softkill  weapons  against  the  perceived  threats,  b  consists 
of  the  major  subfunctions  :  Target  Evaluation;  Result  Evaluation;  Force  Resources 
Evaluadon;  Omdidate  Reaction  Evaluation;  and  Rank  Candidate  Reactions. 

THE  TARGET  EVALUATION  FUNCTION 

The  main  function  of  the  Target  Evaluation  functitm  is  to  assess  the  situation  in  the 
airspace  around  the  ship  and  to  generate  a  set  of  propositions  about  the  established  target 
tracks.  These  propositions  will  be  in  the  form  of  a  threat  list  containing  a  determination  of 
die  level  of  threat  posed  by  each  track.  Each  of  these  propositions  will  be  characterized  a 
confidence  factor  which  indicates  the  strength  of  belief  in  the  given  proposition.  In  later 
stages  of  the  TEWA  process,  this  confidence  fector  will  play  a  role  in  determining  reaction 
ranking. 

The  Target  Evaluation  function  is  triggered  by  the  arrival  of  track  data  from  the 
Read  Data  Frame  function.  This  is  accompanied  by  a  Frame  Ready  signal.  If  no  Reset 
signal  has  been  received,  then  the  Target  Evaluation  function  will  over  time,  build  up  a 
perception  of  the  situation  around  the  ship,  and  update  it  constantly  as  new  data  arrives. 

As  described  above,  the  Target  Evaluation  function  generates  threat  lists  and 
distributes  them  to  the  Candidate  Reactiem  Evaluation  function,  and  to  the  Rank  Candidate 
Reaction  function.  This  is  accompanied  by  a  Threat  List  Ready  signal. 

The  purpose  of  the  Target  Evaluation  knowledge-base  is  to  determine  whether  an 
arbitrary  track  is  a  threat  and,  if  it  is  considered  to  be  a  threat,  quantify  the  level  of  threat  A 
set  of  roles  are  provided  in  the  knowledge-base.  Each  track  is  "submitted"  to  each  rule. 
Each  rule  that  is  satisfied  contributes  evidence  to  one  set  of  limited  propositions  concerning 
that  track. 

Each  rule  is  associated  with  a  certainty  factor.  The  certainty  factor  associated  with 
each  rule  is  a  measure  of  the  reliability  of  that  rule.  Rules  are  written  in  the  following 
format: 

If  A  dien  X  with  certainty  factw  OF 
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TARGETniACK  GENERATOR 


Figure  L  Target  Track  Generator 


where  A  is  called  the  conditional  part  and  X  Ac  conclusion.  Threat  levels  are  based  on  track 
observables  (as  weU  as  wheAcr  Ae  trade  is  cuttendy  under  prosecudon).  Various 
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observable  attributes  of  the  track  are  interpreted,  via  the  tncchariim  of  rules,  in  order  to 
determine  the  level  of  threat.  In  theory,  the  level  of  *rcat  would  be  determined  by 
associating  a  threat  level  with  each  unique  combination  of  track  observables.  In  practice, 

however,  this  is  impractical  because  the  number  of  combinations  is  very  large. 

Our  approach,  therefore,  is  to  have  a  two-level  strategy  of  rule  application.  At  the 
lowest  level,  "raw"  data  is  used  to  generate  a  limited  set  of  hypotheses  about  various  track 
attributes :  identity,  kinematics,  radar  state,  and  engagement  status.  For  each  of  these  four 
attributes,  a  set  of  rules  is  used  to  reduce  the  "raw"  data  into  a  manageable  set  of 
hypotheses  specific  to  the  attribute.  These  hypotheses  then  constitute  the  "data"  to  be  used 
by  the  upper  level  set  of  rules.  The  output  of  this  upper  level  is  a  set  of  propositions  about 
the  level  of  threat  posed  by  the  track.  Each  such  proposition  contains  a  statement  chosen 
from  the  following  list : 

ll\j^ :  Not  a  Threat  The  track  is  believed  to  pose  no  risk  to  the  Force.  A  hostile  track  can 
be  a  NT  (non  threat)  if  it  is  not  believed  to  be  capable  of  harming  the  Force.  A 
"friend"  also  falls  into  this  category. 

T/L*l :  Threat  Level « 1.  A  very  slightly  dtteatening  track. 

T/L*2 :  Threat  Level  ■  2.  A  slightly  threatening  track. 

T/L»3 :  Threat  Level »  3.  A  .moderately  threatening  track. 

T/L-4 :  Tlueat  Level «  4.  A  threatening  track. 

TA^5 :  Threat  Level «  5.  A  highly  threatening  track. 

Rules  to  Generate  Identity  Propoafliflna 

The  identity  propositions  are  intended  to  quantify  the  inherent  potential  of  the  track. 
Th^  quantify  its  destructive  potential  independently  of  its  qiedfic  behaviour, 
if:  ( trackid  » "ExoceO 
then: 

pefontity  is:  'moderateEnen^  withCertainty:  1.0]. 

Basically,  in  order  to  reduce  corap!e.xity.  we  choose  to  categorize  all  track  identities  into 
one  of  5  categories :  Friend;  Weak  Enemy;  Moderate  Enemy;  Strong  Enemy;  Unknown. 
There  are  four  rules  for  testing  track  identity,  one  for  each  of  the  categories :  weak  enemy, 
moderate  enemy,  strong  enemy  and  unknown.  At  the  present  time,  scenarios  involving  the 
intermittent  arrival  of  friendly  and  hostile  units  have  not  been  planned  for  the  TEWA. 
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Hence,  dtere  are  no  rules  identifying  friendly  units  in  this  knowledge-base  that  can  be  used 
later  with  other  rules  to  generate  zero  ducat  levels  with  an  appropriate  confidence  factor. 
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Rules  To  Gengrate  Kinematic  PxQiiQsiiifms 

These  propositions  arc  intended  to  quantify  the  degree  to  which  the  Idncntadc  behaviour 
of  the  track  is  threatening.  In  what  follows,  die  GPA  (closest  point  of  approach)  is  the 
perpendicular  distance  in  tnetres  front  the  ship  w  the  threat’s  direcdon  in  the  horizontal 
plane  and  TTGI  is  the  time  in  seconds  for  the  threat  to  reach  die  CPA  from  its  current 
position  if  it  traveUed  at  its  current  velocity.  The  rules  to  generate  kinematic  propwitions 
areofthefonn: 

if:  (closing  &  (epa  S 100)  A  (ttgi  S  40)  &  (ttgi  >  20)) 
dien: 

(kinematics  is:’strong’ withCertainty:  l.OJ. 

The  kinematics  classes  arc  opening,  strong,  moderate  and  weak.  There  are  thirteen  rules  of 
this  Qrpe. 

Rules  to  Generate  Engagement  Stataa  ProgOSltiaM 

Whether  or  not  the  track  is  currcndy  under  prosecutiem  does  bear  on  the  level  of  threat 
“posed-by  the  track.  After  all.  a  track  that  is  underattack  is  less  of  a  threat  dian  die  same 
track  if  it  is  not  under  attack.  The  rules  to  generate  engagement  status  propositions  are  of 
theftirm: 

if:  (prosecutionStatus  =  ’notUnderProsecution’) 
rtien: 

(mgagementStatus  is  :'nodEngaged'  withCertainty:1.01 

else: 

(engt^mentStatus  is:'engagcd'  widiCertainiy:1.0J. 

There  is  only  one  rule  in  die  knowledge-base  of  this  kind. 

Rules  to  Generate  Propositions  About  Level  of.33treat 

We  now  come  to  die  highest  level  of  rules.  Instead  of  four  rule  sets,  we  have  a 
single  rule  set  The  propositions  produced  by  rule  firings  at  the  lower  level  serve  as  the 
arguments  of  the  rules  at  the  highest  level  The  certainty  factoi  associated  with  each  rule 
will  be  assumed  *  1.0.  The  certainty  of  die  consequent  will  dierefote  be  diiecdy  determined 
by  the  certainty  of  the  antecedents. 


In  HUMBLE,  the  confidence  factws  associated  with  Ac  parameters  of  a  HUMBLE 
enti^  may  take  values  goine  from  *1  m  1.  A  value  of  +1  indicates  Aat  the  system  is 

absdiatcly  certain  that  the  value  of  die  parameter  is  conecL  A  value  of  0  indicates  diat  the 

system  is  completely  ignorant  of  what  die  value  of  the  parameter  should  be.  A  value  of -I 

intficates  Ait  die  system  is  absolutely  certain  diat  the  value  rf  the  parameter  is  not  correct 

Ibe  format  of  H^JMBLE  rules  is : 

iE  (A)  Aem  pc  widiCettainty£Fl. 

If  the  conditional  part  A  of  Ais  rule  is  true  before  firing  0.e.,  c(A)  is  wie)  and  in  what 

follows  the  certainty  of  X  is  denoted  by  c(X),  Ac  new  calculated  value  of  the  certainty  of  X 

after  iule*fiiing  c(XiA)  win  be  calculated  as  follows: 

C<X1A)  *c(X)  +  [CF*{1.0-c(X))]  ifc(X).CF>0 

-c(X)  +  lC3F*(L0  +  c(X))J  ifc(X).CT<0 

•  (cC0^CTy(1.0-min{lc(X)I.ICH))  if  c(X),CT  arc  of  opposite 

sign  and  not  equal  to  *1 

If  c(A)  <  1  Aen  the  raw  certainty  of  X  after  rule  firing  c(XlA)  is  given  by  similar 
formulae  depending  on  c(AX  c(X)  and  c(F) .  In  many  cases,  the  condi  titmal  part  of  Ac  rule 

is  not  sinqile.  The  rule  can  have  a  composite  antecedent  as  foUows: 
if:  (A  and  B)  Aen:  pc  wiACeriaintyK^Fl. 

In  this  case.  Ae  certain^  of  A  and  B  must  be  calculated  before  Ac  mle  can  be  fired.  In 
HUMBLE,ftisdefined3sfonows: 

c(A  and  B) «  mininwm  of  (c(A)/:(B}} 

Generally  q>naMng,  Ae  confidence  factors  associated  wiA  Ae  CPA  and  TTGI  are 
fst^dawirt  at  the  tune  Aat  the  sensor  error  estimates  in  positron,  bearing  and  velocity  are 
calculi^  The  initial  certain^  associated  wiA  TTGI  and  CPA  arc  defined  by  Ac  fcumulae: 
c(CPA)  ■maxtO,l-sigma(<3»AVICPAIl 
cCTTGI)  •maxlO,  1  -  sigma(TTGI)/nTGIIl 
where  sigma(CPA)  and  sigma(TTGI)  are  Ac  standard  deviations  of  Ae  CPA  and  TTGI 
respectively  and  can  be  calculated  fixun  Ac  appropriate  formulae  for  Ac  (3*A  andTTGL 
The  values  of  c(CPA),  c(TTGI),  CPA  and  TTGI  are  used  to  calculate  Ae  certainty  of 
Ae  conAtional  part  of  each  kinematics  rule  and  after  Ae  rule-firing,  Ac  certainty  of  Ac 
conclusion  becomes  known.  This  certainty  can  Aen  be  used  in  a  rule  about  current  track 
parameters  such  as : 

ift  (identity  *  'strongEnemy'  &  (kinenadcs  s'setong*)  &  (engagementStatus  =* 
’notEngaged*)) 


then: 

Pei'cIOfThreat  is:5  withCertaintyrl.O]. 

to  compute  the  value  of  its  antecedent  If  the  values  of  the  other  parameters  making  up  the 
antecedents  are  not  known,  backward  chaining  must  be  used  to  obtain  these  values.  Once 
these  values  are  known,  the  rule  may  be  fired  to  assign  a  threat  level  of  five  to  the  track 
with  a  certainty  which  is  a  function  of  the  previous  uncett^nty  and  the  cturent  uncertainty 
of  the  antecedents.  There  are  thirty  two  rules  of  this  type  in  the  knowledge-base. 

In  order  to  add  a  temporal  aspect  to  the  Threat  Evaluation  function  consider  the 
following  q)grade  to  the  functionality  described  above: 

The  confutation  of  a  threat  ranking  at  t=tQ  will  be  a  function  of  tite  threat  rankings  at  two 
prevfous  time  steps: 

nUlb)  - 1  4*MTUi^  +  2*Nni^to-l)  +  MTL(to-2)  1/7 
The  term  "FTL"  stands  for  "Filtered  Thieat  Level"  while  the  term  "MTL"  stands  for 
"Measured  Threat  Level".  This  represents  a  time-filtered  approach  to  threat  level 
generation.  The  thieat  ranking  is  mostly  dependent  on  current  threat  parameters.  However, 
foere  is  some  dependence  upon  past  threat  ranking.  The  computed  value  of  TL(t^  should 

be  rounded  to  the  nearest  whole  number  in  order  to  be  consistent  with  the  way  the  TL 
values  arc  utilized  in  other  sections  of  the  TEWA. 

Now  each  of  the  MTL  values  will  obviously  have  a  certainty  value.  The  certainty  of  the 
filtered  threat  level  is  calculated  finom  the  certainties  of  the  measured  threat  levels  of  the 
current  and  two  previous  time  steps  by  using  the  same  ftamula  as  for  the  threat  levels. 


■7TH  f  iKUuSi*n 


Under  our  current  design,  one  and  only  one  rule  from  the  rule  set  based  on  current 
track  parameters  will  fire  for  each  uack.  We  now  look  at  how  patterns  of  threat  "behaviour" 
over  time  affect  threat  levels.  The  following  rules  concern  manoeuvering  targets  or  targets 
for  which  the  estimated  target  velocity  direction  is  subject  to  error.  The  following 
definitions  are  required  to  understand  these  rules : 

Definitions : 

•  Let  the  line  defined  by  the  velocity  vector  of  the  track  be  "A". 

•  Let  the  line  joining  the  track  to  the  ship  be  known  as  "B". 

•  Let  G(A  ->8}  be  defined  as  the  angle  measured  clockwise  swept  out  starting  at  A 
and  moving  to  B. 

•  Let  G(A  ->8,1  s  Iq)  be  defined  as  the  value  of  B  measured  at  t » tQ. 
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Rules: 

IF  (  (ABS(  B{A->B,t»to  )  ><5)  AND  (  ABS(  6(A.>B,t  -  «o*3)  >10) 

AND  CrL<4))THEN 

Reduce  belicfifeonfidenoe  that  TL  <  4  and  increase  confutence  tfwt  TL  ■  4. 

More  specifically,  "divide"  Ac  existing  certainty  assodated  with  the  TL  (Aat  is<4) 

amongst  Ae  hypothesis  that  TL  « 1,2,3  and  Aat  TL  »  4.  This  may  be  confusing,  so 
an  exati^le  foOows : 

„  Suppose  the  FTL  value  for  a  Areat  is- 2  wiAC- 0.71.  Further  suppose  Ae  rule 

immediately  above  is  satisfied.  Under  Ais  condition,  we  should  obtain  Ae 
following  kvcls  Ateat  wiA  associated  certainty  factors: 

FTL-2,C-0.35 

FrL-4,C»0.35 

ENDIF 

Further  rules  can  be  developed  to  cover  Ae  oAer  orientations  of  a  laterally 
manoeuvering  target  ityproadiing  a  ship.  The  Candidate  Reactiem  Evaluation  knowledge* 
base  must  be  informed  of  a  manoeuvering  target,  because  Ais  will  have  an  effect  on 
determining  whether  it  is  eBgageablc.  Thc  framat  of  Ae  rules  in  Ae  Result  Evaluation  and 
Force  Resources  Evaluation  knowledge-bases  are  dmilar  in  fernn  to  Aose  of  Ac  Target 
Evaluation  knowledge-base. 

THE  CANDIDATE  REACTION  EVALUATION  KNOWLEDGE-BASE 

The  purpose  Candidate  Reaction  Evaluadon  is  essentially  twofold.  Firsdy,  Ae 
process  has  to  determine  Ac  engageability  of  each  "surviving"  track  with  respect  to  each 
weapon  system.  Secondly,  it  has  to  predict  Ac  effectiveness  of  each  [threat-reaction]  pair 
Aat  survives  Ae  engageability  determinations. 

The  ultimate  purpose  of  CRE  is  to  ^oduce  a  set  of  reaction  options.  Each  reaction 
ration  conasts  of 

•  A  track  to  be  prosecuted; 

•  A  weapon  system  cr^iable  of  prosecuting  Ae  track  immediately; 

•  A  prediction  of  the  effir-tiveness  of  Ae  use  of  Ae  weapon  against  the  track  if 

weapon  action  is  undertaken  immediately. 


The  number  of  reaction  options  reflects  the  number  of  different  reaction-track  combinations 
that  are  feasible  (i.e.engageable).  The  specific  algorithm  for  engageabiliiy  determination  of 
the  SM-2/STIR  system  is  given  by  the  following  rule: 

if:((sm2Statusa'opeiational')&(stirAcanSeeTrackAtRollOver)&(sm2CanInteiceptTrack) 

&(stirAAvailabiIity)) 

then:[engageability  is:’engageableBySm2SalvoStirA'withCcrtainty:1.0. 

engageability  is:'engageableBySm2SingleStirA'  withCettaintyrl.O] 

The  antecedents  of  this  rule  are  determined  within  the  simulation  framework.  The  criteria 
for  establishing  that  a  track  is  engageable  by  the  [76  mm  /  STIR  or  LIROD  ]  is  defined  by  a 
similar  rule.  In  order  to  ensure  engageability,  it  is  not  sufficient  that  track  interception  occur 
inside  the  76  mm  gun's  envelops.  In  addition,  a  STIR/LIROD  fire-control  radar  must  be 
capable  of  tracking  the  target  In  our  TEW  A,  we  have  made  the  following  simplifying 
assumption :  a  test  is  made  regarding  whether  die  STIR  can  track  the  target  at  the  reaction 
time.  If  this  test  is  satisfied,  we  conclude  that  the  ST*R  in  question  can  track  the  target 
under  consideration.  The  engageability  rules  for  the  CIWS  gun  system  are  similar  to  those 
of  the  76  mm  gun. 

The  following  deflnitions  and  information  are  used  in  our  speciflcation  of  rules  for 
softkill  engageability.  The  threat  radar  mode  can  exist  in  three  states :  passive,  search  and 
track.  The  Deployment  Time  is  the  time  interval  from  die  decision  to  use  the  softkill 
weapon  until  the  moment  of  softkill  weapon  activation.  This  is  very  short  for  the  use  of  a 
jammer.  For  chaff,  this  represents  the  time  from  decision  to  use  until  the  chaff  canister 
explodes.  The  Hme  to  Start  Having  an  Effect  is  the  time  from  softkill  weapon  activation 
until  the  weapon  can  begin  having  a  measurable  effect  on  the  track.  The  Time  Before 
Bumthrough  is  the  time  (measured  from  the  decision  to  use  a  softkill  weapon)  until 
bumthrough  occurs.  Bumthrough  occurs  when  the  ship  becomes  the  dominant  target  as  far 
as  the  threat  is  concerned.  We  will  assume  for  simplicity's  sake  that  bumthrough  will 
always  occur  at  a  specific  range  (threat-ship).  The  turn  on  time  is  the  time  (measured  from 
the  decision  to  use  the  softkill  weapon)  until  the  threat's  seeker  (radar)  begins  to  receive  a 
signal  ffr>m  the  softxill  weapon  whose  magnitude  exceeds  the  minimum  de'ection 
threshold.  In  simpler  terms,  the  turn  on  time  is  the  flrst  point  in  time  at  which  the  threat  can 
become  aware  of  the  presence  of  the  softkill  weapon. 

The  following  must  all  be  true  in  order  for  a  uack  to  be  engageable  by  the  jammer 
and/or  chaff.  Although  not  explicidy  stated  in  TF-THEN"  format,  these  conditions  can  be 
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put  together  in  order  to  create  a  rule  for  engageability  (IF  all  conditions  satisfied  THEN 
track  is  engageable  this  sofddU  we:^): 

1.  The  softkill  status  (from  Fbrce  Resources  Evaluation)  must  be  either  "Operational" 
or’Degraded*'. 

2.  The  trade  must  be  in  eitiier  "Search"  or  "Track”  modes. 

3.  The  time  to  bumduough  must  exceed  the  sum  of  die  deployment  time  and  the  time 
10  have  an  effect  OtheTMose.  it  is  too  late  to  use  the  weapon. 

4.  The  present  time  (diis  is  the  time  at  which  the  decisimiU)  use  the  jammer  might  be 
taken)  plus  die  deployment  time  nuist  ex^ed  the  tum<on  time.  Odierwise,  it  is  too  early  to 
use  die  si^tkill  weapon. 

In  addition,  we  have  blind  zmM  constraints  widi  respect  to  the  use  of  the  jammer. 


There  are  two  types  <rf  effectiveness  measures  associated  with  a  particular  (track,  weapon] 
pair.  Rrst,  there  is  the  predicted  effectiveness  of  the  wet^xm  in  (festroying  /  decoying  the 
track.  Secondly,  diere  b  die  predicted  impact  of  the  reaction  mi  the  Force  (e.g.  risk  of 
fratricide,  reduced  fighting  capability,  etc.).  Note  that  the  effectiveness  prediction  is  only 
performed  on  those  (track,weapon]  pairs  that  pass  the  engageability  test.  All 
{track,weaponl  pairs  that  fail  the  engageability  test  ate  not  subject  to  any  further 
oonsidetation  at  die  "present  time". 

Let  die  term  Eff  A  stand  for  die  predicted  effectiveness  of  a  weapon  system  with  respect 
10  the  goal  of  destroying  the  track.  Eff  Aba  function  of  two  parameters;  the  type  of  the 
weapon  and  die  type  of  the  target  In  order  to  determine  Eff  A  for  a  given  [track,SM-2]  pair 
a  table  of  probabilities  b  used.  Similarly  there  are  models  to  calculate  Eff  A,  for  the  76  mm 
gun,  the  close*io  we^ion  system,  die  diaff  system  and  the  jamming  system. 

In  order  to  predict  chaff  interference  diere  ate  rules  to  determine  whether  or  not  the  use 
of  diaff  will  interfere  widi  any  line  of  sight  to  any  track.  Chaff  reactions  generally  involve 
more  dian  one  chaff  cloud.  To  simplify  things,  we  said  that  if  any  chaff  cloud  is  predicted 
to  obscure  any  line  of  sight,  then  Eff  B  *  1  (i.e.,  there  b  an  "impact  on  the  Force").  We 
further  assumed,  for  the  purposes  of  this  calculation,  that  all  active  sensors  (STIRs  -t- 
phalanx  -f  Search  radars)  are  located  at  the  centre  of  the  ship.  Innally,  the  prediction  of 
chaff  interference  b  only  meaningful  when  the  prediction  is  made  with  respect  to  a  specific 
point  in  time  or  interval  of  time.  To  simplify,  we  will  only  examine  interference  at  a  single 
pdnt  in  time.  The  point  in  time  will  be  the  deployment  titrw  Q.e.,  if  the  chaff  clouds  were 
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out  there  now,  would  there  be  obscuration  ?).  Under  the  limitadons  of  the  model,  i.e.,  the 
ship  does  not  move  and  under  conditions  of  no  wind,  the  ship's  sensors  will  be  effective  in 
zones  well  clear  of  the  clouds. 

We  now  consider  the  determination  of  Eff  C,  a  measure  of  how  much  the  use  of  the 
weapon  reduces  the  future  fighting  capability  of  that  weapon.  It  will  be  assumed  that  Eff  C 
will  be  set  to  1  if  the  use  of  the  weapon  reduces  remaining  stock  below  some  critical  level 
(as  determined  by  rules  in  the  knowledge-base).  Otherwise  Eff  C  will  remain  «  0. 

RANKING  OF  CANDIDATE  REACTIONS 

The  purpose  of  this  function  is  to  generate  a  plan  of  action  for  dealing  with  threats. 
We  have  threat  evaluations,  resource  evaluations,  and  result  evaluations.  We  have 
[tr3ck,weapon]  pairs  where  the  track  is  engageable  by  the  weapon  and  where  associated 
effectiveness  values  have  been  established.  Our  task  is  now  to  generate  a  plan  of  action 
based  on  all  this  information.  In  order  to  generate  a  plan,  we  need  to  establish  the  goal  (or 
goals)  of  our  plan.  The  highest  level  goal  is  to  protect  ourselves  and  our  consort  from 
destruction.  Our  plan  should  be  the  one  that  gives  us  the  highest  probability  of  survival. 
Another  goal  is  to  conserve  resources.  Intuitively,  this  goal  is  less  important  than  the  goal 
of  survival  Another  less  important  goal  is  to  minimize  "impact  on  the  Force"(interference). 
The  ranking  of  plans  is  accomplished  by  an  optimization  function  in  the  TEWA  object  of 
the  simulator  (see  figure  2).  In  what  follows,  T|  is  a  track  identifier.  We  will  assume  that 

there  are  "N"  tracks  in  the  system  at  any  time.  Let  C(i,0)  be  the  confidence  that  track  i  is  a 
friend,  C(i,l)  be  the  confidence  that  track  i  is  at  Threat  Level  »  1  and  Q(i)  be  the 
uncertainty  associated  with  determining  the  threat  ranking  of  track  T|.  In  addition,  let 
rri.wjbe  a  track-weapo.i  combination  where  weapon  W|^  is  capable  of  engaging  uack  Tj 

and  let  Eff_A(iJc),  Eff_B(idc),  Eff_C(iJc)  be  used  to  refer  to  the  Eff.A,  Eff_B,  EfLC 
values  associated  with  a  (Tj,WJ. 

Plan  Scoring  Using  an  Optimization  Function 

Survival  points  are  calculated  for  each  track  T|  that  has  at  least  one  weapon  assigned  to 
it  in  the  proposed  plan  by  computing  the  value  of  the  following  function: 

1  *  (Eff_A(i.*)*C(i.l))  +  2  *  (Eff_A(i,*)*C(i,2))  +  3  *  (Eff_A(i,*)*C(i,3))  + 

4  *  (Eff_A(i,*)*C(i,4))  +  5  *  (Eff_A(i,*)*C(i,5))  +  3  *  (Eff_A(i.*)*Q(i)). 
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Denote  this  value  by  Fi-  The  character  is  used  in  order  to  reflect  the  fact  that  there  may 
be  nxire  than  one  weapon 

to  track  Tj.  We  desire  plans  that  try  to  ensure  dtat  all  threats  are  subject  to 

prosecution.  Mote,  specifically,  we  wish  that  any  plan  that  deals  with  n+1  traclra  be 
superior  to  any  plan  that  deals  with  n  tracks  regardless  the  F|  values  associated 

with  the  plan.  This  can  be  accomplished  by  computing  our  final  survivability  result  as 
follows: 

Survivability  « (F|  +  n  y(N  + 1) 

where  n*  number  of  tracks  in  the  plan; 

N  «  number  of  tracks  submitted  to  TEWA. 

Fix’ll  ttrack(i),  wcapon(k)l  pair  associated  with  a  plan  will  have  an  E£f_B  parameter 
associated  with  iu  If  Eff_B  »  1  then  the  use  of  weapon(k)  wll  produce  interference.  A 
quandtadve  measure  of  the  amount  of  interference  associated  with  a  plan  is  given  by  the 
following: 

Number  of  ftrackfiV  weaoonfk)!  Pairs  where  Eff-Bjsll 
Total  Number  of  [track(0,  weapon(k)]  Pairs 

If  every  [track(i),  weapon(k)l  combination  yields  interference,  this  value  will »  0,  if  half 
produce  interference  the  value  will  equal  OJ,  and  if  no  comWnation  yields  interference,  die 
value  will  equal  1.0.  The  higher  this  value  the  better.  Denote  this  ratio  by  Impact 

Each  (track(i),  wcapon(k)l  pair  associated  with  a  plan  will  have  an  Eff.C  parameter 
associated  widi  it  If  Eff_C  «  1  Aen  Ae  use  of  weapon(k)  will  produce  resource  usage 
problems.  A  quantitative  itteasure  of  Ac  extent  of  resource  usage  problems  associated  wi  A 
a  {dan  is  given  by  the  following : 

Number  of  ftrackfi).  weaponflcll  Pairs  where  Eff  C 
Total  Number  of  itrack(i),  weapon(k)]  Pairs 

If  every  [track(i),  weapon(k)l  combination  yields  resource  usage  problems,  Ais  value  will 
s  0,  if  no  combinations  yield  resource  usage  problems,  Ae  value  *  1.0.  Denote  Ais  ratio 
by  Res.  Usage.  The  proposed  optimization  function  F  for  scoring  a  given  plan  is  as 
follows: 
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F(Plan) «  0.8  •  (Survivability)  +  0.1  *  Ompact)  +  0.1  •  (Res.  Usage) 

The  plan  vwth  the  highest  score  is  implemented  immediately. 

RESULTS  FROM  KNOWLEDGE-BASE  TESTING  SCENARIOS 
The  knowledge-base  TEWA  for  a  TRUMP-like  ship  was  tested  in  the  scenario  shown 


in  figure  3. 


Range  »  200  km 
Time*  t  +  5 
Type  *  Shallow  Diver 


Range  «  2(X)  km  Range  »  200  km 

Time  « t  +  5  Time  » t  + 10  Ranffc  »  200  km 

Type  ■  Sea  skimmer  Type  »  Sea  ricimmer  YuM»t-¥5.5 

I  I  Type  ■  High  Diver 


Range  «  200  km 
Time«t 

Type  «  Sea  skimmer 


mer  V 

V 

ESCORT 


/ 


TRUMP 


Range  *  58.9  km 
Time  *  t  +  10.5 
Type  «  Hybrid  Diver 


Ranges  200  km 
from  escort 
T1mc»t  +  32 
Type  »  High  Diver 


Figure  3.  A  Testing  Scenario  for  the  Knowledge-Base  TEWA 

In  this  scenario,  six  targets  are  directed  at  the  TRUMP-like  ship  and  one  at  the  escort.  The 
sequence  of  weapon  assignments  performed  by  the  knowledge-base  as  well  as  the  targets 
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destroyed  are  shown  in  figure  4.  It  is  to  be  noticed  that  three  different  weapons  are 
assigned  to  the  fint  high  diver.  The  SM-2/STIRB  fues  and  misses  this  target  However, 
the  system  sdll  remains  asagned  to  it  As  this  target  flies  into  the  ship,  the  gun/STIRA  and 
QWS  systems  are  respectively  assigned  to  the  high  diver.  Thus,  after  die  kill  assessment 
for  die  fint  five  targets  is  complete,  three  weaptm  systems  are  assigned  to  die  sixth  target 
because  die  seventh  target  is  not  engageable  by  any  of  these  ^sterns.  The  gun/STIRA 
finally  destroys  the  sixdi  target  In  this  testing  scenario,  therefore,  six  targets  are  destroyed 
and  one  missile  hits  the  escort  The  knowledge-base  TEWA  was  also  tested  in  a  scenario 
with  five  threats  and  in  diis  case  neither  the  TRUMP-like  ship  nor  die  escort  was  hit  by  a 
missile. 


WEAPON /RADAR  HYD  SSI  SS2  SD  SS3  HDl  HD2 


HYD 

SSI 

KILL 

KILL 

SM.2/STIRB 


GUN/STIRA 


GUN/STIR  B 


GUN/LIROD 


CIWS 


SM>2  s  Standard  Missile  2  CIWS  s  Close-in  Weapon  System 

LIROD  s  Gun  radar  STIR  A,B  s  Radars 

*  s  indicates  an  assignment  of  weapon/radar  to  threat 


Figure  4.  Snapshot  from  the  Knowledge-Base  Testing  Scenario 


REAL-TIME  CONSIDERATIONS 


The  knowledge-base  TEWA  which  has  been  described  above  does  not  function  in 
real-time.  The  field  of  real-time  knowledge-base  systems  is  a  field  of  current  research 
which  has  not  fully  developed  yet  The  author  has  read  the  descriptions  of  three  real-time 
systems  in  the  open  literature.  These  are  known  as  Pilot’s  Associate,  the  Adaptive 
Suspension  Vehicle  and  the  Autonomous  Land  Vehicle.  They  are  described  in  references 
[12]  and  [14].  The  Pilot's  Associate  is  a  knowledge-base  system  which  attempts  tactical 
situation  assessment  and  weapon  assignment  for  fighter  aircraft  In  reference  [12],  a 
methodology  is  given  to  make  it  function  in  real-time.  The  real-time  version  of  Pilot's 
Associate  has  been  tested  in  various  environments  to  assess  its  performance,  task 
scheduling  and  real-time  interaction  with  a  realistic  environment.  The  real-time  version  of 
Pilot's  Associate  is  expected  to  be  functional  by  1992. 

The  author  has  analyzed  some  of  the  real-time  requirements  for  the  simplified  naval 
TEWA  problem,  i.e.,  that  of  a  single  warship  attacked  by  anti-ship  missiles.  A  preliminary 
survey  shows  that  the  total  time  for  rule-firings  and  backward  chaining  in  the  Target 
Evaluation  knowledge-base  ot  figure  2  should  be  compatible  with  the  data  output  rate  of  the 
ship's  sensor  fusion  process.  This  data  rate  will  depend  on  the  type  of  sensor  fusion 
chosen.  In  the  case  of  the  Result  Evaluation  knowledge-base,  the  total  time  for  rule-firings 
should  be  compatible  with  the  weapon  system  for  which  it  is  performed.  Thus  in  the  case 
of  missile  systems,  this  time  must  be  compatible  with  the  illumination  time  of  the  fire- 
control  radar  to  establish  that  the  track  has  been  destroyed.  In  the  case  of  a  sofikill  weapon 
system,  it  must  be  compatible  with  the  amount  of  time  required  to  establish  that  the  track 
has  been  successfully  decoyed.  The  author  sees  that  the  status,  availability  and  stock  level 
of  weapon  systems  as  estimated  by  the  Force  Resources  Evaluation  knowledge-base 
should  be  made  known  to  the  blackboard  controller  as  soon  as  possible,  Le.,  the  fastest 
possible  rule-firings  are  necessary  to  mtdce  sure  that  the  central  unit  of  the  TEWA  is  aware 
of  the  new  ship  situation.  A  preliminary  analysis  shows  that  if  the  total  time  to  perform 
engageability  calculations,  effectiveness  predictions  and  ranking  of  plans  is  compatible  with 
the  data  output  rate  of  the  sensor  fusion  process,  a  new  reaction  can  be  selected  each  time 
die  tactical  situation  changes. 

At  the  present  time,  the  author  has  not  studied  the  scheduling  of  each  one  of  the 
above  tasks  :  (Target  Evaluation,  Force  Resources  Evaluation,  Candidate  Reaction 
Evaluation,  Ranking  of  Candidate  Reactions)  with  respect  to  the  central  blackboard.  It  is 
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hoped  that  an  efficient  task  scheduler  can  be  found  to  execute  these  tasks  as  rapidly  as 
possible.  If  this  is  not  the  case,  some  work  must  be  done  to  have  the  tasks  executed 
eoncunently  so  that  the  above  requirements  can  be  satisfied. 

These  ideas  constinite  a  first  glance  of  real-time  knowledge-base  systems  for  naval 
Command  and  Control  and  they  could  be  subject  to  change. 

CONCLUSIONS 

l)The  performance  of  the  knowledge-base  TEWA  was  examined  in  several  anti-air 
warfare  testing  scenarios  aiui  found  to  be  sadsfactoiy.  The  performance  of  a  TRUMP-like 
ship  with  a  convendtmal  TEWA  was  tested  in  similar  scenarios  (but  with  fewer  threats) 
using  a  validated  Ship  Comtxu  System  Simulation  and  found  to  have  comparable  results 
widi  die  ship  having  a  knowkdgC'base  TEWA. 

^It  would  tqipete’ diat  die  knowledge-base  approach  to  the  Tactical  Situation  Evaluation 

of  a  warship  under  attadr  by  and-^ip  misdles  is  a  reasonable  one.  Some  of  die  problems 
to  be  ovetcmne  in  this  field  are  i&ndficadon  of  air  ducats,  esdmadon  of  threat  kinemadc 
parameters,  evaluadon  of  threat  seeker  head  behaviour  and  predicdon  of  the  behaviour  of 
manoeuvering  targets.  This  study  shows  that  these  areas  could  be  reasonably  handled  by 
the  knowledge-base  approach.  A  reasoning  approach  whereby  informadon  from  kinemadc, 
radar  state  and  idend^  parameters  are  put  together  provides  a  good  tacdcal  picture  for 
wetqxHi  assignment  References  [1]  to  [5]  are  loddng  at  die  applicabiliQr  of  knowledge¬ 
base  systems  to  Tacdcal  Situadmi  Evaluadon. 

3) The  current  form  of  the  knowledge-base  TEWA  was  found  to  be  adequate  to  a 
jfjngie  ship  equipped  with  radar  guided  weapon  systems,  surveillance  radars,  an  electronic 
support  measure  system  and  an  infiared  search  and  track  (tevice.  There  was  a  debate  as  to 
the  suitability  the  knowledge-base  approach  in  doing  Threat  Evaluadon  and  Weapon 
Assignment  for  various  kinds  of  hardkill  and  softkill  weaptm  combinations.  In  order  to 
accommcdate  a  laser  guided  hardkill  weapon  or  a  different  kind  of  softkill  weapon  in  the 
knowledge-base  TEWA,  it  would  only  be  necessary  to  change  the  rules  concerning  the  use 
of  diese  systems  in  the  appropriate  knowledge-base  and  integrate  the  latter  to  the  funcdons 
of  the  platform. 

4) The  tacdcal  situation  around  the  ship  is  perceived  through  its  sensors  which  measure 
parameters  relating  the  target  to  the  ship.  Radar  sensors,  for  example,  will  measure  the 
slant  range  and  bearing  of  a  target  and  will  return  values  which  are  subject  to  errors.  In  the 

target  evaluadon  knowledge-base,  a  beginning  has  been  made  with  Mycin  type  uncertainty 
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to  obtain  a  consistent  set  of  threat  levels  from  kinematic,  radar  state  and  threat  identity 
parameters.  Although  the  results  obtained  were  sadsfactory,  there  is  no  guarantee  that  this 
is  die  best  method  for  dealing  with  sensor  data  uncertainty. 

S)T1ie  knowledge-base  TEWA  that  we  have  built  is  not  a  real-time  system.  In  order  to 
make  it  execute  in  real-time,  separate  studies  would  have  to  be  done  to  choose  an 
ai^nopiiate  computer  ardiitecture  and  computer  software  to  implement  these  ideas  in  a  real¬ 
time  knowledge-base  TEWA.  The  preceding  secdon  presents  some  ideas  that  must  be 
addressed  in  a  real-dme  naval  knowledge-base  system. 
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THE  CF-18  DIAGNOSTIC  AND  MAINTENANCE  EXFEfIT  SYSTEM  PROJECT 
J.  a  Tubman,  M.  D.  Brinamaad*.  C  C.  Lumb*.  M.  M.  Mendoza',  and  l.aL  Tan' 

Abstract 

The  goal  of  this  preset  was  to  apply  Al  technology  to  and 

makttenance  of  CF-18  aimraft  The  doma^  chosen  was  toroughpul  increase  tor 
the  ANAJSM-469  radar  test  set  tor  the  AN/APG-65  radar,  with  the  radar  transmitter 
as  unit  under  Historical  records  were  makite^r^  about  syrr^s^Mns.  teste,  and 

probable  causes  of  fadt^  Th^  were  u^  to  conpute  a  new.  faster  test 
sequence,  sublet  to  ^tain  safety  constrsdnte.  The  system  is  b^f^  tested 
at  tfte  CFB  Cc^  Lake  RTS  te^»oratory,  and  the  results  of  the  field  test  w^  be 
teialysed  to  mid-  to  late-1992.  Swne  f^Smtoary  concto^ons  were  niched  betora 
this  field  trial  and  will  be  discussed  h^e. 


‘lUseMdi  O^KS.  *Fnenn  lienieer,  ABwtt  RcKHte  CowcA  ASwMai  OMpwkig 
OlgKy 


tbm  — Intwnnr*  and  sspklr  of  tte  ooxious  oorto  of  olxecoft  eporotod 
br  tbo  Conodlon  bxMd  rocooo  is  •  doMOdlng  sad  iapoetsat  task.  Largs 
lUMriaass  of  higbljr  skillod  toetmlcians  sro  coqalcod  to  kosp  today's 
sophistieatod  aircraft  xaady  for  flight,  tho  JULbsrta  Kssoarch  Council 
(MO  iqpproaebsd  tbs  Chief  Of  Rsssarch  and  Ds«sl<^mant  (CIlM»  with  tbs 
idM  of  agiplylag  artificial  iatslligsaos  (AI)  and  orpsrt  systaa  todmolo- 
gias  to  problsaa  rslatsd  to  tbs  diagnosis  and  aaintsnancs  of  CT-lt  air- 
eeaft.  lbs  CF-H  sxport  systaa  project  (CTES-lt#  saa  uadsrtaksn  with  tbs 
aaia  objsctiss  of  iassstigatiag  tbs  fsaaibUity  of  applying  AX  and  ozpsrt 
aystiaa  to  Cr-1*  avionics  aaintsnancs.  .  .It  was  hoped  that  tha  ^plication 
ti>***  tscbaologiss  would  load  to  cost  savings,  iaersassd  safety,  aad 
ibpxowad  flight  xsadinoss. 

Pisgaosis  aad  miatsaaaoa  of  aircraft  is  s  largo  doaaia,  aad  it  was 
aaesssary  to  sslsct  seas  xalowsat  subset  of  tbs  problsa.  lbs  first  phase 
of  tA*  project  was  dsvotod  to  this  task.  In  th*>  sad,  it' was  daeidad  that 
an  ^ropriats  probloa  would  be  using  artificial  intslligsnes  mad  sspsrt 
systsas  to  Increase  the  throughput  on  an  existing  pises  of  autonatic  test 
•guipuant,  aaaely  the  AP/OSM-4C9  radar  test  set  (KIS) .  lbs  RIS  is  used 
to  test  an  Alf/AP6-«S  radar  oa  tbs  CT-lt  aircraft,  tbase  XX  involved  per- 
fozaiag  an  analysis  of  tba  problsa  area,  aad  dsciding  oe  the  functional¬ 
ity  requiresants  aad  high  level  design  of  the  si^aa  wbicdi  we  have  called 
the  Knowledge-based  Adaptive  lest  Sequencing  Systea  (KAISS) .  Itae  last 
phase  involved  perfotaiag  a  detailed  analysis  and  design  towards  produc¬ 
ing  field  testing  a  prototype.  It  was  dstetadned  that  for  the  proto¬ 
type,  we  would  concentrate  on  laproving  the  throw^put  only  sjt'.en  testing 
the  radar's  transmitter. 

Ihis  paper  reports  on  the  results  of  this  project,  including 
descriptions  of  the  problem  area,  the  approach  taken  towards  a  solution, 
and  lessons  we  have  learned  sc  iar  in  the  project. 


iM^ti^iili^ 


-■VW; 


ptWWWSf5 


stuecTXQV  or  m  psobleii 


Tba  OTES-IS  project  is  s  feasibility  study  intended  to  invev'tigate 
the  apprc^riateness  and  practicality  of  applying  expert  systea  technolo¬ 
gies  to  the  saxntenance  of  Cr-1»  aircraft.  Initially,  the  intent  eas  to 
develop  a  protocype  expert  systea  for  fuel  system  aaintenance.  However, 
this  problea  was  eventually  solved  by  other  aeans,  which  gave  us  the  op¬ 
portunity  to  investigate  sosm  other  aspect  of  the  aircraft's  aaintenance. 


Me  began  by  examining  the  current  situation  with  regard  to  CF-18 
amintenance.  Me  spoke  with  pe^la  in  the  Directorate  for  Fighter  and 
Trainer  Engineering  and  Maintenance  (DFTEM),  the  Directorate  for 
aerospace  Support  Engineering  (DASEKG),  the  Mational  Research  Council 
Laboratory  for  Intelligent  Systems,  the  Mew  Shipboard  aircraft  prograume, 
tatek  Testware,  and  the  Alberta  Electronics  Test  Centre.  A  wide  range  of 
possible  projects  were  suggested,  including  ones  that  were  not  e^qpert 
systems. 


•Iremativea  were  pr^osed  to  DND.  These  were:  an  expert  sys- 
to  augment  the  ATE  for  a  small  instrumentation  subsystem;  an  unspeci¬ 
fied  expert  system  for  another  aircraft  such  as  the  CF-5  or  the  Sea  King 
helicopter;  trend  analysis  of  maintenance  data  from  the  AMIIS  or  DKS  data 
systems;  trend  analysis  of  engine  data,  to  detect  adverse  trends  and  an¬ 
ticipate  engine  faults;  and  an  automated  technical  manual  system  that 
would  put  Canadian  Forces  Technical  Orders  (CFTOs)  on  hypertext.  DND 
chose  the  expert  system  for  augmenting  the  ATE. 


Since  this  was  still  a  rather  large  domain,  it  had  to  be  narrowed 
down  further.  With  the  help  of  the  people  in  DFTEM,  the  area  that  was 
finally  selected  was  increasing  the  throughput  of  the  AM/DSM-469  Radar 
Test  Set  <RTS),  during  the  diagnosis  of  problems  with  the  transmitter  of 
the  CF-18' s  AN/APG-65  radar.  It  was  felt  that  the  existing  software  on 
the  »TS  went  through  its  test  sequence  in  a  very  straightforward,  unin- 
tgj^]^igent  way,  and  that  the  throughput  on  the  machine  might  be  increased 
if  the  test  order  was  redone  in  a  way  that  took  past  experience  into  ac¬ 
count  . 
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AvUtion  •l*ctronic«,  o»  tritMlea.  !•  an  Intagral  part  «f  day-to-day 
tlipht  eparatlona.  Coov>Uoatad  aXactroaic  davicaa  for  »a»i«atlon  and 
eMHoaleation  provida  capabilltiaa  anch  aa  »aintainlng  In-flisht  poal- 
tiona,  pinpointing  daatinatlona,  and  landing  aafaly.  thorafora,  tha 
■aintananca  of  thaaa  alactronic  aystaaa  ia  a  significant  aapact  of  tha 
Mroluitttics  Industry* 

Avionics  aaintananea  involvao  diffarant  lavala  of  eoaplaxity  in 
diagnosis  and  rapair,  ranging  fro«  r^lacanant  on  tha  aircraft  of  tha 
largar  assaid>lias  of  alactronic  bosas,  to  najor  rapair  of  tha  aa»ll«r 
cards  at  tha  anppliar's  alactronics  laboratory.  Haintananca 
lavala  iavolva  diffarant  typas  of  tost  oqoipnant.  »ilie-ln  tost  (BIT) 
ladieata  abather  a  unit  U  tenlty  and  naads  raplaeanant  HI.  Aatonaele 
•^ipaant  (ATS)  la  aoad  to  tost  a  failed  onit  furthar  to  datamino 
of  its  anb-aa ■  ■idhlias  has  eaoaad  tha  failora.  ATEs  ara  nsad  at 
■ld.l««ol  Miatanaoea  sh^  lAara  tha  isolated  snb-assanblias  ara 
and  s»y  ba  sent  for  najor  rapair.  A  unit  uhich  is  replaced  on 
tha  aircraft  is  nomaUy  rafarrad  to  as  a  Moapon  raplaeaahia  vtsmbly 
(HRA),  a  sub-assaafcly  n^laead  at  nalntananca  facilities  is  a  shop 

raplacivabJa  assasd»ly  (SRA) .  In  brief,  BITs  diagnose  doun  to  tha  MBA 
level,  and  ATEs  diagnose  «RAs  doan  to  tha  SRA  level. 

•  Avionics  naintananca  is  parfonnad  by  highly  a)d.llad  technicians  uho 
have  aa  intinate  understanding  of  tha  diffarant  electronic  assasdslias, 
and  mxpmztlam  ia  operating  tha  tasting  aguipnont  and  in  intarproting 
togfl«g  results.  The  ate  is  an  inportant  tool  for  these  technicians.  It 
relieves  them  from  tha  tedious  atd  time  consuadng  tasks  of  inctruaen*; 
sat-ups,  calibrations,  plug/cabla  changeovars,  and  taking  readings.  The 
ATE  performs  such  tasks  on  the  unit  under  test  (OUT)  that  is  connected  to 
it  by  autonatically  directing  a  sequence  of  tests.  The  tests  are  com¬ 
puter  controlled  through  a  test  program  uhich  is  often  uritten  in  the 
(Abbreviated  Test  Language  for  All  Systems) . 


ATLAS  language 
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For  the  CFES-IS  project,  the  tesget  of  application  is  the  tiro  ATE 
stations  within  the  CF-18  avionics  »aintenance  facility  of  the  Canadian 
Armed  Forces  at  Cold  Lake,  Alberta.  These  stations  house  two  radar  test 
sets  (RTS),  designated  AM/gSM-469,  for  testing  and  fault  isolating  WRAs 
of  the  CF-18  AK/APC-65  radar.  An  RTS  consists  of  racks  of  testing  equip- 
SMint,  connectors,  and  an  HF-100  coeiputer  and  test  programs,  which  control 
the  equipment  through  a  general  purpose  interface  bus  (O^IB,  or  IEEE- 
488}  .  There  are  72  different  types  of  WRAs  that  can  be  connected  to  the 
RTS  as  OLTs,  and  we  are  concentrating  on  the  radar  transmitter  for  this 
project. 

Bach  type  of  WRA  requires  a  different  set  of  test  procedures,  as  de¬ 
tailed  in  the  test  requirement  ctocumsnt  (TRD)  of  the  URA.  Software  writ¬ 
ten  in  ATLAS  encodes  the  test  procedures  for  execution  on  the  RTS  com¬ 
puter,  and  is  referred  as  the  Test  Frogram  Instructions  (TPI)  for  the 
«RA.  Technicians  control  the  execution  of  this  test  program  and  the 
cox&tained  test  procedures  through  a  CCTmand  program  called  the  Test  Exec¬ 
utive  I2J .  The  Test  Executive  allows  the  user  to  specify  the  statement 
nuae>er  in  the  test  program  where  testing  wi^l  start  (Start  At  Entry 
point,  or  SAE),  and  a  statement  number  where  testing  will  st^  (Halt  At 
Statement,  or  BAS),  if  any.  OOT  testing  may  be  carried  out  by  sillying 
a  series  of  SAE-BAS  psirs  until  the  RTS  has  stopped  to  indicstv  s  fault, 
or  all  the  required  test  procedures  have  been  executed.  normally, 
however,  the  technicians  would  sisply  siq^ply  the  very  first  SAE  for  the 
UUT,  to  perform  the  tests  end-to-end  rather  than  in  groups. 

The  test  program  for  the  radar  transmitter  [3]  contains  a  sequence 
of  at  least  160  test  procedures  partitioned  into  14  groups  (4].  For 
safety  reasons,  the  first  eight  test  groups  must  be  performed  in  the 
given  sequence,  and  the  last  six  test  groups  may  be  re-ordered.  A  job 
order  for  transmitter  testing  is  specified  by  personnel  who  replaced  the 
transmitter,  on  a  Maintenance  Form  CF543  attached  to  the  UUT.  The  form 
may  include  descriptions  of  the  WRA  failure,  and  fault  codes  produced  by 
the  BIT.  Experienced  ATE  technicians  may  be  able  to  use  this  information 
to  decide  on  the  test  procedure  that  will  most  likely  find  the  faulty 
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SRA,  and  the  test  group  to  execute  first  in  the  re->ordered  test  sequence. 
The  purpose  of  KhTSS  is  to  assist  the  technician  in  waking  this 
sequencing  decision.  The  foXioeing  section  details  the  spproac.t  taken  to 


aecoepliob  this  task. 


The  resequencing  problea  is  an  ^iadsation  problea  in  idiich  the 
goal  is  to  rearrange  a  series  of  test  {^rations  to  ainiaiae  the  ejq)ected 
required  to  detect  a  fault,  ror  the  purposes  of  this  discourse,  ee 
shall  describe  too  classes  of  resequencing  problea:  the  gmnmrml  rese- 
qmneiag  problM;  and  the  apmelul  resequencing  problea.  The  teo  classes 
are  distinguished  entirely  by  the  way  in  iddch  eaq>eeted  duration  is  coa- 
pttted. 

In  earh  case,  a  nueber  of  coanon  assunptions  are  aade  regarding  the 
aature  of  the  test  operations  ehich  are  to  be  resequenced.  The  eossson 
asstaptiotts  shall  be  presented  first,  to  be  folio eed  by  a  description  of 
the  special  assuagitioas  differentiating  the  teo  classes  of  sequencing 
problea. 

hasiaptioa  1: 

Test  i^rmtioam  aay  be  deeosgwsod  and  described  blerar- 
ebieally. 

«rh<ip  is  certainly  the  case  for  the  test  operations  de¬ 
scribed  in  the  TPI  for  the  Wl/OSM-469  Radar  Test  Set  (RTS), 
upon  ehich  our  research  eas  baaed.  The  tests,  as  described 
in  the  ATIAS  source  code  are  organised  into  several  levels  of 
hierarchy:  Test  Blocks,  Test  Groups,  and  Teat  Steps,  for  our 
purposes,  a  Test  Step  is  the  fundamental  unit  of  test  opera- 
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tion;  •  Test  Gtoup^  Is  sn  ordered  set  of  one  or  more  Test 
Steps,  end  e  Test  Block  is  e  set  (ordered  or  unordered)  of 
Test  Groups  end/or  other  Test  Steps. 

Aasumptloa  2: 

rest  operations  aro  ossaatially  independent  of  one  an¬ 
other.  «»et  is,  the  instructions  executed  by  the  Automated 
Test  Squipamit  in  the  performance  of  one  test  ^ration  ere 
independent  of  any  test  (^rations  which  may  be  rescheduled 
relative  to  the  test  ^ration  in  question. 

Again,  this  is  (for  the  most  pert)  the  ease  tor  the 
BM/GSM>4fi9  Bedar  Test  Set.  «»is  assumption  gives  rise  to  the 
need  for  constraints  on  the  resequencing  of  test  operations, 
for  exas«>le,  eithin  a  'test  Croup',  It  ia  frequently  the  ease 
that  one  Test  Step  may  define  state  information  ehich  mill 
■odify  the  behaviour  of  a  subsequent  Test  Step  within  the 
same  Test  Group. 

Xf  this  is  to  occur,  these  Test  Steps  must  be  con¬ 
strained  to  be  executed  ia  a  fixed  and  predetermined  order. 
Xn  the  ease  of  our  test  system^  Test  Groups  are  by  definition 
static,  that  is,  the  teat  steps  within  each  test  group  can 
never  be  resequenced  with  respect  to  one  another. 

Asswdptlon  3: 

Test  operations  at  a  given  level  in  the  hierarchy  are 
subject  to  certain  constraints  restricting  how  they  may  be 
reordered.  These  constraints  are,  however,  relatively  sim¬ 
ple,  and  do  not  cross  levels  of  the  hierarchy. 


3  For  our  purposes,  a  'Test  Group'  is  a  set  of  TPI  instructions 
delineated  by  entry  points. 
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Wi*  priniiry  soure*  et  conatrainta  on  ro8«<iuancin9  taata 
la  tha  n*«l  to  aaaura  that  aafaty  taata  ara  parfotned  bafora 
any  actual  parfotwanca  taata  ara  cota»ancad.  In  tha  caaa  o« 
tha  UTS,  aavaral  groupa  ot  aa£a-to-tum-on  taata  auat  ba  a»a- 
eutad  in  a  fiaad  saquanea  bafora  any  of  tha  parfonaanca  taata 
ara  axacutad.  Xn  aupport  of  thia  typa  of  limitation,  a  al«- 
pla  eonatraint  ayatam  ahieh  takaa  advantaga  of  tha  hiararchi- 
eal  daacription  of  tha  taat  prograai  aaa  davalopad.  Thia  con- 

atraint  ayataa  ia  daacribad  in  tha  follouing  aaction. 

aaoMptioB  4: 

ftor  aaeh  taat  aparatlon,  aithar  tha  probability  of  da- 
tmetiag  a  faolt  ia  kaom  a  priori,  or  it  can  ba  rmliably  eom~ 
pffffM  trott  any  taat  cparatlona  contained  by  tha  ona  In  qnaa— 
tioa. 

Pot  aach  atoade  taat  operation,  the  probability  of 
findinp  a  fault  auat  ba  known  prior  sequencing  tha  testa.  In 
the  prototype  systM  dawal^)ad  by  tha  hlbarta  Raaaarch  Coun¬ 
cil,  these  probabilitiaa  ara  prowidad  by  a  database  aodula 

astimataa  baaed  upon  past  history  and  the  ayaptoaa  re¬ 
ported  for  tha  DOT  currently  under  eonaidaration. 

Por  eoaposita  taat  operations  (taat  operations  idiich 
contain  ona  or  aK>ra  aub-^?arationa) ,  satisfaction  of  this  aa- 
is  assured  by  Assunption  2.  Since  no  test  operation 
■ay  be  contained  by  more  than  one  “parant*,  it  is  always  pos¬ 
sible  to  recursively  coaputa  tha  probability  of  a  coiqrosite 
oporation  datacting  a  fault  based  upon  tha  probabilitiaa  of 
its  constituent  test  operations.  It  is  possible  to  deison- 
strate  that  the  probability  of  detecting  a  fault  in  a  sub-se¬ 
quence  of  tests  is  independent  of  the  order  in  which  the  op¬ 
erations  are  performed. 
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Aasoaptlon  S; 


ACOAic  t«st  operMtions  (t^st  operations  at  tAa  Joaest 
iavei  of  thm  hierarchy^  Aave  a  l^lxad  duration^  and  irili  al*^' 
ways  run  to  ooapiation  without  regard  to  tdietlier  or  not  t^ey 
€%tect  a  /auit. 

Although  this  is  not  strictly  truer  it  provides  a  very 
convenient  and  poverful  abstraction#  especially  when  consid¬ 
ering  the  special  re^e<|uencing  problem.  In  actual  fact#  the 
duration  o£  a  Test  Step  (recall  that  *Test  Steps'^  are  the 
Atomic  test  Operations)  may  vary  slightly  depending  on 
whether  a  fault  is  found.  That  is#  the  Test  Steps  will  al¬ 
ways  run  to  conflation  regardless  of  whether  a  fault  is 
found#  but  must  taka  tism  to  print  an  error  message  Cor  even 
ecMtlMS  resolve  an  asbiguity)  when  a  fault  is  found.  The . 
adnor  deviations  incurred  when  a  fault  ia  ctotected  are  not 
considered  significant. 

Aasomption  i: 

All  testing  is  ianedlately  halted  when  the  first  fault 
is  detected. 

this  assuaftion  is  absolutely  crucial  to  the  functions 
described  below  for  eoeputing  the  expected  duration  of  a  test 
sequence.  This  is  because  we  assume  that  after  a  fault  is 
detected  no  additional  tests  need  be  executed#  and  that  the 
duration  of  a  test  which  is  not  executed  is  zero. 

ThA  Special  Reaecnifincinq  Problem 

The  special  resequencing  problem  is  characterised  by  the  assuxiftion 
that  test  operations  are  essentially  self-contained  and  independent  of 
one  another.  Under  this  model#  we  presume  that  the  expected  time  re¬ 
quired  to  perform  a.  particular  test  operation  depends  solely  upon  the 


"noriMil*'  duration  of  tha  operation,  and  the  probability  uith  iihich  »•  can 
•xpoct  it  to  detect  a  fault. 


•ased  upon  this  aasunptlon,  the  expected  tiae  Ts  to  execute  B  teat 
eperationa  arranged  on  a  aequenee  0o.0l,02,  ia  gieea  in  equationa 
(1)  and  (2)  below: 


idtere 

t|  -D}e(t-P|)t|4i  «» 

#imI  iflittM  D|  Is  th#  sspsetsd  durstlofi  ths  tsst  ppsrtttlon  to  ^Imi 
position  to  tlm  noqtiwncop  and  F|to  tho  probability 
of  tbo  toat  oparatiem  to  tbo  position  to  tbo  so* 
qjitofico  dotoettog  a  fauto 

.  sndl  olMiro  , 

In  .O 

Gisws  this  dascriptioo  of  cost  l<t»ratl<»i)  of  a  soguoneo  of  tost  cp^ 
orations#  it  to  possiblo  to  dofino  a  *<^  rolatiwiship  as  follow: 

0|<C]|iff  a  soqoonoo  of  tost  oporations  costs  loss  oton  Pj  fol*  (3) 
loos  0|  than  0|  procodos  O;  to  an  otterviso  on* 

changod  soqnwco#  that  to#  ifi  starting  froo  a  so- 
qyottco  Woro  0|  procodos  Oi  and  oachanging  thoir  posi¬ 
tions  rosttlts  in  a  docroaso  in  cost* 

rurthomoro#  it  is  possiblo  to  dononstrato  that#  gison  tho  cost 
function  (1)#  tho  follosing  is  truo: 


XI 


viyivk  0i<0j,pj<0fc«*0i<0k  <5 

«h«M  nsulta  (the  derieetloa  le  eedtted  due  to  extreae  uglinese), 
shoe  os  that  the  '<»  ceietion  Is  both  trsnsltlee  end  Independent  o£  any 
other  test  sctieities  in  s  sequence,  thus  the  special  resequencing  prob- 
lea  le  equlealent  to  sorting  e  llet  o£  nusdaers,  and  can  be  solved  optl- 
aally  In  0{nlogtd  tine. 


neaeauenclnig  PrftblfBI 

the  general  resequencing  prt^lea  la  distinguished  f roa  the  special 
xesequenclng  problen  by  the  assuaptlon  that  teat  operations  are  not  en¬ 
tirely  independent  txaa  one  another*  and  that  there  exists  a  certain  nat¬ 
ural  ordering  to  the  ope^atlaas.  Onder  this  aodel*  ee  presuae  that  the 
expected  tine  required  to  pertoxa  a  particular  test  operation  dsfWMls  not 
only  upon  the  •norsal*  duration  of  the  operation*  but  also  upon  any 
penalties  ehleh  aay  be  levied  tor  deviating  troa  the  "natural  ordering* 
of  the  test  operations. 

<yt.f  is*  given  a  set  o£  R  teat  operations  Oq,  Ol ,  02.  —  On-1  •«- 
umm  that  teat  operation  0l  can  only  be  executed  without  penalty  way  when 
it  la  executed  laaediately  following  On.  Xn  the  ease  of  the  RTS*  these 
take  the  fora  safety  tests  which  mat  be  executed  when  starting 
a  block  of  tests  free  an  entry  point*  but  which  are  not  executed  if  the 
hlock  of  tests  Is  started  as  a  result  of  coapletlng  the  test  block 
wach  IsMdlately  precedes  It  in  the  »PX.^ 

Based  upon  these  assueptlons*  the  expected  tiae  TQ  to  execute  R 
test  operations  arranged  In  a  sequence  Os0*Os1*O82>  •“•0s(n-1)  Xs  given  in 
equations  (€)  and  (7)  below: 


*  The  test  operations  defined  by  the  TPI  are  normally  exerted 
•ramnont' lxll.v  in  £ocxn  of  An  ond  to  ond  test*  At  tho  ond  of  OAch  block, 
of  testa  iaa  goto  statement  which  jun^a  around  the  first  few  statements 
in  th^beginniVof  the  next  block  of  tests.  These  few  statements  are 
intended  to  re-execute  the  safe-to-tum-on  tests  when  a  test  block  is 
manually  rtin  by  the  operator. 
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To  •  to 

«tex« 

t|  -  ♦  Ool  ♦  0  * 


<C) 


17) 


triMr*  0  i*  •  p*xaut*tioo  fuactioft  aapping  th*  aat  of  lateoar* 
CZM  0  to  0-1  onto  iatooors  trcm  0  to  n-l 


•nd  nhoxo 

P(U)-0 
0 

f>itiiait)r(S  etiMcvino 

and  nhoso  PWilWW  4»  tl»  tJ»n  pontlty  ineuzzod  tox  tont  oporo« 

it  in  onoeutod  aajrwtoco  otbox  than  InMili- 

Mid  »iitn  D|  i«  tko  onpoetod  docntioo  of  tbo  tost  ^ntioo  in  tbo 
#*  position  in  tte  soqaonco.  snd  P)ls  ths  pzohabiUty 
od  ttm  tost  oposstiott  in  tho  P*  position  in  tlio  so- 
qpmneo  dstoeting  a  fonlt. 


i*  l<0,  or 

if  Ok  is  tho  tost  oposstioo  ofal^ 
-aatacollp*  procodos  0|.or 


to  -0 


fella  spocisl  Aciao  pr^lon  siMsOf  tho  prosonco  of  tho 

pdialfey  tocsn  prevonts  us  fron  dsfiaino  o  siaplo  *<’  rolstlon  which  pro¬ 


vides  sn  ordering  relation  on  tho  test  operations.  We  believe  tho  solu¬ 
tion  to  the  general  resequeneing  problem  to  be  *(JP-Hard,  although  we  have 

not  attanpted  to  prove  it. 
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Mm  Mntionad  in  tho  section  describing  the  assuaq^ions  reXsting  to 
the  test  sequencing  problems^  we  ere  required  to  consider  s  nui^r  of 
lisdtstions  m  the  order  in  which  test  operations  can  be  executed*  The 
main  source  of  these  limitations  for  the  AM/USM<-469  Radar  Test  Set  was 
the  existence  of  seireral  groups  of  safety  teats^  tdiich  sust  be  executed 
in  a  fixed  order  prior  to  commencing  any  other  group  of  tests. 

these  Xisdtations  easily  could  have  been  accosnodated  by  implement* 
ing  a  test  sequencer  in  such  a  way  as  to  leave  the  safety  tests  un^ 
touched,  and  only  consider  for  resequeccing  those  tests  which  appear 
later  in  the  TTS.  Xt  was  our  choice,  however,  to  consider  the  possibil* 
ity  of  somewhat  moro  coe^lex  Mnstraints  when  designing  our  system. 

hlthoogh  it  was  possibla  to  provido  a  very  general  form  of  con* 
etrainta*  auch  ae  hlleir*s  tamporal  logic.  IS],  we  opted  for  e  aijq»lor 
formlism  which  tmuld  not  bo  more  cosputationally  complex  than  tha 
aequeneing  problem.  The  formalima  we  selected  was  based  upon  the  or* 
ganisatiM  of  the  activities  in  a  test  plan  into  a  nuxd>er  of  hierarchical 
blocks,  and  then  designating  each  block  as  either  static  or  dj^namic.  A 
static  block  is  ons  whose  eontmts  most  be  executed  in  e  fixed  order, 
while  e  dymemie  block  Is  one  whose  cmtents  may  be  executed  in  any  order. 
A  static  block  may  contain  a  dynasdc  block,  or  vico*versa;  tho  con* 
etraints  apply  only  at  the  current  level  in  the  hierarchy,  they  are  not 
Inherited  retained  blocks. 

this  form  of  constraint  allows  ths  specificstioo  of  s  wide  variety 
of  eeqoeacing  constraints^,  but  is  sufficiently  restrictive  that  satis* 
faction  of  the  constraints  is  still  Itrivially)  oasy. 


5  Certainly,  «  much  wider  variety  that  was  strictly  required  for  the  task 
of  resequencing  tests  for  the  AN/APG-65  radar  transmitter. 
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TtM  t«st  Mquaacwr  dMi9iMd  to  run  ••  «a  indopondont  progra« 
which  would  nod  aa  input  file  duexihlnp  o  not  of  toot  oporotiooo  and 
thoic  ematcainta,  and  which  would  panocato  an  output  filo  daaeribing  tho 
oedae  in  which  tha  taat  aetiwitiaa  abould  ba  axacutad.  thin  pcogran  ia 
iiiwokad  and  aamnitad  upon  damnd  by  tha  databaaa  coaponant  of  tha  aoft- 
wan,  whiai  alao  pcowidaa  tha  aaac  intaefaea. 

•axliac  In  pi^ar,  wa  daaezibad  two  claaaaa  of  aavianciny  prob- 

lan.  tbaaa  two  claaaaa  eomapood  to  two  anin  aodaa  of  oparatioo  of  tha 
■SS.  tha  paaanl  aaquanetnj  problaa  comapoada  to  tha  aoeaal  uaa  of  tha 
MXS  ia  ihlrh  opaxaton  coatxolling  tha  pxoyxaa  aaaually  axa  panittod  to 
atart  -t— oaly  at  antxy  poiata,  which  forcaa  tha  aafaty  toata  to  ba 
aa-xwa  fox  ovaxy  naw  aatxy  point,  tha  apacial  aaquanciay  pxeblaa  x«- 
flaeta  a  hyiw  ttmt  Iral  hada  of  opaxation  ia  which  opaxatoxa  axo  panittad 
to  aaairwta  taat  pxogxaai  ataxting  at  any  axbitxaxy  atatana^  auabax* 
laaaaadag  tba  atataoanta  an  eoxxactly  aalactad)  allowing  tho  aafaty 
taata  to  ba 

Xa  to  paxait  tha  awot  flaaxbla  poasibla  analyaia  of  tha  taat 

^  ita  lnilaniurwriTm  Ineladaa  faciUtiaa  to  awppoxt  both  no(2aa 

^  wgantiaa.  tho  dofaalt  aoda  ia  tha  •Staxt  ht  latxy  poiax*  aoda  in 
whiat  ft-T—*  naaguaneing  ia  paxfosnad;  tha  *Staxt  ht  htataMwnt*  aoda 
■ay  ba  apaeif iad  optionally. 

n«  iaplwantatiatt  of  tha  apacial  aagaaneing  auda  waa  dona  aaing 
guiekaoxt  l«l .  b  nuabax  of  bauxiatica  wan  txiad  fox  tha  gaaaxal 
px^laa.  tha  bauxiatic  finally  aalactad  waa  a  txinaxy 
aoxt  r«l  which  waa  dawBoatntad  to  axhibit  high  paxfoxnnca  while 
alaoat  alwaya  aehiaving  optiaal  {and  always  naax-optinll  nsulta  fox 
pscblawM  tha  aixa  of  htS.  thia  can  ba  axtandad  to  an  n-ary  bufcbla  aoxt 
*  ccapatational  coaplaxity  of  0(nl  (ni^  -  nw))  «Aesa  HI  is  tha  nunbex  of 
tost  operations  to  ba  saq;uancad. 
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TlM  d*tab«M  eonpoMot  of  E»TSS  otoKOO  oad  ■ointaioo  iafomotion 
uood  ia  tost  soqttaneio9.  This  iaeXudss  tooting  iafotsntioa  for  sseb  typo 
of  MUi  (o.g.*  co<iaico<l  test  gtoops  and  procodozos,  and  SMJt,  BAS,  and  typ¬ 
ical  duration  for  oacb  to«t>.  and  data  rocordad  fron  oach  tost  activity 
on  tlM  RTS  fo.g.*  wn  isfonaation.  BIT  codas*  tost  aoatoor  of  tho  proeo- 
doro  Mlinco  tho  RTS  dstoctod  a  fault* '  and  RR7SS-g«»aratad  tost  soqoaaeo) . 

TIm  database  applieatloa  fonetioas*  eallod  tho  Rata  Colloetor*  am 
naialy  for  aes^iag  tost  activity  typo  data  frfaa  tho  «sor  and  storing 
this  data  ia  tbs  databaso.  Tboso  am: 

•  Tbst  detivicjr  Xnitlttloa.  fho  asor  previdos  KRTSS  with  tho 
aorial  atadsar  of  tho  CR543  attaebad  to  tho  OUT  boing  tostad 
on  tbs  RTS,  and  scan  iafotsotien  fron  this  fona  such  as  tho 
ODT  part  mmbmr  and  aorial  auabar*  sad  BIT  coda  aad  failura 
dMCciptiMis  iadicatiag  tho  problons  oith  tho  WT.  Tho  tost 
aoguoaeor  is  then  osoeutod  aad  aay  msultiag  soguoaeo  is 
atomd  ia  tho  databaso. 

•  Toae  sogoaneo  Oisplay.  Tho  osor  vious  tho  tost  aa«^wneo  that 
RRTSS  bm  oaaorstad  for  a  tost  activity. 

•  RbCzy  of  fboit  Ooesceiea.  Tba  asor  oetom  tho  atatasKot  aiaa- 
bar  displayed  by  tho  RTS  nboa  it  stopped  to  iadieato  fault 
datoetioa. 

•  toot  Activier  Cooplotiaa.  Tho  asor  indicates  if  a  tost  ac¬ 
tivity  is  eonplotad*  l.o.,  ao  aoro  dstoctod  faults  will  b« 
meordad. 

h  database  server  based  relational  database  system,  dBASE  ZV,  is 
used  in  isgileiaenting  the  Data  Collector,  to  take  advantage  of  basic 
database  mad,  write,  and  edit  functions  provided  in  the  software  pack¬ 
age.  A  database  softwam  package  will  also  be  better  equipped  in  the 
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management  of  a  growing  database.  The  manu-buildlng  facilities  Of  dBASE 
ZV  have  been  used  in  user  Interface  development. 


Analysis  of  the  ATIA5  Code 

In  order  to  get  the  statement  numbers  of  the  Start”At  (SAS)f  Start” 
At-Entry  (SAE),  and  Halt-At  (HAS)  statements,  it  was  necessary  to  examine 
the  ATLAS  source  code  for  the  transmitter  diagnosis  portion.  Bach  test 
in  the  source  code  was  examined,  one  at  a  time.  The  8AS,  SAE,  and  HAS  of 
each  test  in  the  program  were  recorded  in  a  notebook.  Also,  the  BCOF 
call-outs  of  each  test  were  recorded.  This  process  took  about  3  weeks  to 
do,  and  had  to  bA  repeated  when  a  new  version  of  the  ATLAS  code  was  re¬ 
leased  part  way  through  the  project. 

The  SAS,  SAE,  HAS,  and  PCOF  information  was  entered  into  dBASE  IV 
files  for  use  by  KATSS. 

Inatallatlon  and  Field  Teat 

The  prototype  software  and  its  supporting  equipment  (a  Sun  Micro¬ 
systems  SPARCstation  1+  workstation)  were  deli/ered  to  the  RTS  iKaboratory 
at  CTB  Cold  Lake  in  October  1991.  It  has  been  in  use  there  for  the  pur¬ 
pose  of  collecting  data,  with  a  planned  test  period  of  four  months. 

The  principal  objective  of  the  field  test  is  to  determine  whether 
the  a.>proach  of  heuristic  resequencing  based  on  statistical  records  will 
work  when  the  program  has  access  to  real  auintenance  data.  A  secondary 
objective  of  the  field  test  is  to  find  out  whether  having  KATSS  as  a  sep¬ 
arate  auxiliary  system  will  be  satisfactory,  or  whether  an  integrated 
system  is  needed.  Finally,  we  want  to  find  out  the  opinions  and  sugges¬ 
tions  of  the  RTS  technicians  with  regards  to  improvements  and  other 
changes,  especially  with  regard  to  the  user  interface. 
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Because  Of  an  unexpoctedly  low  incidence  of  failure  in  AN/;-PG-65 
radar  transmittersr  it  is  likely  that  the  field  study  will  be  extended 
from  the  original  4  months  to  10  months  or  more. 


OOMCLaSXOKS 

Although  at  the  time  this  paper  was  written,  the  results  of  the 
field  test  were  not  yet  available,  we  were  able  to  reach  some  interim 
conclusions  as  a  result  of  our  analysis  of  the  problem  domain. 

The  first  conclusion  we  reached  was  that  this  approach  is  not 
likely  to  yield  a  significant  speed-up  for  this  particular  domain  (radar 
transmitters) .  Bart  way  through  the  project,  the  ATLAS  code  was  re-writ¬ 
ten  by  Amtek  Testware,  and  we  were  told  that  this  resulted  in  a  401  re¬ 
duction  in  the  time  needed  to  diagnose  a  transmitter.  This  factor  alone 
greatly  reduced  any  scope  for  ia^rovement,  (It  also  confirmed  DND's  ini¬ 
tial  belief  that  there  was  room  for  is^rovement  in  the  efficiency  of  the 
RTS  software.)  In  seeking  a  performance  in^jrovement  in  ATE  software,  the 
place  to  start  is  the  improvement  of  existing  conventional  ATE  code. 
Only  when  this  has  been  done  should  the  client  investigate  the  use  of 
more  sophisticated  technologies,  such  as  AI. 

The  second  conclusion  was  that  this  approach  was  impeded  by  the  re¬ 
quirement  to  use  SAEs  when  the  resequencing  algorithm  reordered  tests 
(that  is,  the  general  resequencing  problem)  .  Running  the  test  from  the 
SAE  number  instead  of  the  SAS  number  means  repeatedly  running  a  lot  of 
safety  tests.  The  safety  tests  take  a  significant  amount  of  time.  The 
same  safety  tests  might  be  re-run  many  times  if  a  lot  of  resequencing 
takes  place.  The  technicians  told  us  that  the  tests  would  find  nothing 
new  each  time  they  were  run. 

The  third  conclusion  was  that  effective  use  of  statistical  tech¬ 
niques  requires  large  volumes  of  data.  It  became  apparent  during  the 
first  three  months  of  the  field  trial  that  it  would  take  many  months  to 
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gather  enough  data  for  KATSS  to  be  useful.  An  eltemative  technique  that 
might  have  been  more  appropriate  is  case-based  reasoning®  17] . 

The  final  conclusion  is  that  using  a  system  like  KATSS  in  conjunc¬ 
tion  uith  an  eaistlng  system  like  the  RTS  is  inconvenient.  Since  there 
is  no  interconnection  between  the  RTS  and  KATSS,  the  operators  must  enter 
information  Into  KATSS  manually.  It  would  be  much  more  convenient  for 
the  information  to  be  entered  automaticslly  by  the  computer  that  is  doing 
the  diagnosis.  Also,  it  would  be  better  if  the  functionality  of  KATSS 
was  Just  another  module  of  en  overall  ATE  system,  rather  than  a  separate 

system. 
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6  Late  in  the  development  stages  of  KATSS,  we  found  out  that 

ARC  had  used  case-based  reasoning  on  a  similar  project 
at  ARC  naa  usea  results .  It  had  the  advantage  of  being 

o,  a.t.  b,  th.t 

time  it  was  too  late  to  change  our  approach. 
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AN  EXPERT  SYSTEM  APPLICATION  FOR  TROUBLESHOOTING 
THE  CF18  F404  ENGINE 

W.D.E  Allan*  and  R.C.  Best* 

Abstract 

Troubleshooting  the  CF18  F404  engine  often  irivolves  referring  to  data  recorded  by 
the  Inflight  Engine  Condition  Monitoring  System  (lECMS).  The  lECMS  routinely 
records  engine  and  aircraft  parameters  during  flight  A  software  suite  has  been 
developed  by  GasTOPS  Ltd.  to  graphically  present  this  data.  Troubleshooting 
procedures  have  been  amended  to  delude  the  analysis  of  the  plots,  focusing  on 
features  unique  to  known  faults.  This  paper  proposes  an  expert  system  application 
to  provide  assistance  to  technicians  in  utilizing  this  information  in  the 
troubleshooting  process.  The  ability  of  the  system  to  recognize  fault  signatures 
and  to  be  readily  updated  with  new  pattenis  will  be  central  to  the  success  of  the 
proposed  cgcplhation.  The  role  of  the  system  in  supporting  second  and  third  line 
maintenance  activities  will  also  be  discussed.  An  over-riding  consideration  in  the 
application  of  expert  system  technology  to  the  maintenance  of  the  F404  is  the 
necessity  to  maintain  the  level  of  expertise  of  the  technicians.  The  system  will 
provide  recommendations  for  solutions;  final  maintenance  decisions  must  always 
rest  with  the  technician. 


'Rropulsion  Engineer  and  ^IVopuision  Section  Head,  Medianical  Projects  Branch,  Aerospace  Maottenance 
Develc^xnent  Unit,  CFB  Trenton 
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IhB  ocBnltment  to  cn-cx»dition  naintenanoa  for  the  CF18  edxcraft 
has  resulted  in  the  developnant  of  nsaarous  means  of  detecting  ocnponent 
and  system  ocnditions.  Ihe  malntoianoe  of  the  F404  ergine  has  bej»  a 
major  focus  in  titese  efforts.  Hence,  mch  of  the  grcundwork  is  ocaplete 
to  si(fX3rt  the  developnent  of  the  ei<pert  system  preposed  in  this  paper. 

A  vast  amount  of  historical  and  ocnteiporary  CF18  fi^iter 
aircraft  data  is  available  si^porting  the  F404  engine  maintenance 
activities.  Rcq)id  access  to  maintefance  information  is  key  to  preventing 
needless  activity  through  the  pxrvision  of  timely,  accurate  and  helpftil 
troubleshooting.  This  paper  constitutes  a  proposal  for  an  expert  system 
application  for  F404  trcublesrnoting,  and  oemments  on  pcssibillties  at 
other  levels  of  maintenance. 


Msassicw; 


lha  two  sources  of  data  fa*:  F404  aaintenanoe  are  the  aircraft, 
and  the  maintainers  at  all  levels.  Ihe  aircraft  is  equipped  with  a 
Maintenance  Status  Data  Recording  System  (M5CRS)  which  stores  2drcraft 
unserviceabilities  as  identified  by  the  logic  of  the  Mission  Couputers. 
Life  cycle  counts,  operating  exceedances,  sensor  failures  and  other 
anenalies  related  to  the  engines  are  recorded  using  a  sub>system  of  the 
MSCRS,  the  Inflight  Bigine  Condition  Monitoring  Systaa  (XECMS).  Ihis 
sy5ta&  also  allows  pilots  to  initiate  records,  and  automatically  records 
a  thrust  check  during  each  takeoff.  There  is  also  a  Maintenance 
Monitoring  lenel  (MiP)  where  numerical  codes  are  set  by  aircraft  logic 
identifying  unservloeabilities  or  operating  exceedances  for  ground  crew 
action.  All  MSi3S  data  is  stored  on  a  magnetic  tepe  vhich  may  be  removed 
from  the  aircraft  upon  landing,  and  delivered  to  the  Integrated  Ground 
Data  Station  (ICXG)  then  required.  The  TODC-hased  lOS  system  is  capable 
of  {resenting  data  to  the  maintainers,  and  archiving  the  Aircraft  Data 
Files  (ACF)  for  future  xefermxoe. 

The  second  major  source  of  maintenance  data  for  the  F404  is  the 
maintainers  themselves.  Dispersed  at  three  levels  of  maintenance, 
technicians  rely  on  their  own  eiperienoe  and  judgement,  in  <tddition  to 
standard  procedures,  to  repair  unserviceabilities  or  r^xiUd  asseehlies. 
The  proposed  systan  must  be  designed  by  these  experts  (technicians, 
maintaiance  managers  and  aigineers)  and  sipported  by  them.  For  the  system 


will  rs^idly  beocne  obsolete  as  an  "expert"  if  it  is  noft  conscientiously 
and  effectively  modified  to  evolve  %d.th  changing  maintenance  and 
infonoaticn  processing  euotivities.  Ihe  expert  aystein  iqpplication  will  be 
described  in  relation  to  the  level  of  maintenance  activity  lAiich  it 
si^ports. 


Ihe  first  level  of  maintenanoe  involves  the  servicing  of 
aircraft  and  the  rectification  of  minor  xmservioeabilities.  This  includes 
any  problem  which  can  be  solved  in  less  than  24  hours. 

The  he2a±  of  autonated  first  line  activity  is  the  First  tine 
TTcudsleshootlng  System  (FITS)  Which  ocaisists  of  a  laptop  cotputer  linked 
to  Idle  ZOS.  The  softw2u?e  is  actually  two  of  a  suite  of  six  distinct 
programs  [1]  liiich  make  up  the  Engine  Performance  Itonitorlng  (EEM)  system. 
These  ate;  ta»e  Event  Di^lay  Program,  vtoich  graphically  presents  engine 
and  flight  parameter  data  acquired  by  the  IBCK5,  and  the  Mission  Analysis 
Program,  which  gr^diically  presents  lew  freipiency  data  acquired  throughout 
the  fli^  for  a  Hwitgd  nunber  of  engine  and  fli^t  parameters.  The 
latter  is  very  useful  in  determining  engine  related  faults  when  no  JWP 
code,  or  pilot  record  is  available  for  an  aircrew  r^rted  problean.  Its 
tise  still  relies  greatly  on  a  technicians  experience  and  technical 
expertise. 

In  using  the  Event  Di^lay  Program,  the  first  line  technicians 
are  provided  with  a  Cancxiian  Forces  Technical  Order  (CPiO)  vhich  assists 
them  in  applying  standard  troubleshooting  decision  trees  to  the  IBCM5 
data.  For  a  given  englixe‘re).ated  xmservioeability,  the  code  gsxerated 
by  the  lECMS  will  provide  the  CFIO  referenoe  for  identifying  eigine 
parameters  of  interest  in  the  troubleshooting  process.  By  visually 
analyzing  the  graphs  and  referring  to  the  FITS  CFTO,  the  technician  can 
usually  isolate  the  fault,  or  at  least,  eliminate  other  possibilities.  A 
sanple  of  the  Event  Displ;^  program  screen  is  shewn  in  Figure  1. 

The  mechanism  behind  the  proposed  exqpert  ^stem  at  the  first 
line  of  maintenance  will  be  the  determination  of  engine  fault  signatures 
in  t-<»nTis  of  the  queiLitative  details  of  inflight  events.  The  technicians 
rely  heavily  on  the  use  of  Canadian  Faroes  Technical  Orders  to  guide  them 
in  their  work;  decision  trees  and  fault  confirmation  are  logically  laid 
cut  in  these  volumes.  The  proposed  exqxert  system  will  convert  the 


infanaatlon  held  in  ttvese  wlianes  into  an  on-iscareen,  ocnvenient  and 
stroasalined  presentaticn  of  the  daclsiai  criteria.  (It  will  not  be  a 
step-bjnst^  interactive  activity.)  Ae  technicians  work  through  the 
troubleshooting  trees,  characteriatics  of  the  graphical  IBCt'S  data  will  be 
analyzed  to  achieve  a  successful  cxsnclusion.  Rectification 
rcooBinendaticns  would  be  available,  for  oonslderaticn  by  tec^niclans  in 
repairing  the  angina. 

28-JAN-92  CF-18  Mobile  Engine  Qoto  Interpfctotion  Computer  Version  1.0 
09:35:52  First  Line  Interim  Troubleshoiling  Program 

ADF:  G746D0281.E01  R -  L - B  C-Slort  ,  24366  (s«c) 
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Figure  1;  Event  ELotting  Pcagtaa  Screen  SsaplB 

A  mlel  of  the  F404  cxantrol  systao  has  been  developed  to  assist 
the  technician  in  analyzing  gr^^hs  of  lECMS  data.  Engine  paxaneters  and 
signals  deteznined  fzan  control  schedules  can  be  displayed  with  actual 
engine  data.  Diis  is  intended  to  illuminate  those  qualities  of  the  graphs 
which  may  indicate  the  source  of  problems.  A  dynamic  model  of  the  F404 
engine  has  also  beoi  developed  which  will  be  capable  of  conputer 
simulations  of  faults;  this  will  likely  prove  invaluable  in  determining 
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more  «ffec±ive  isolation  nsothods  for  those  tare,  botb  trowblesone  faults. 

m  sene  cases,  the  MMP  oodte  history  of  the  engine,  or  the 
maintenance  history  of  a  particular  eigine  oorponent,  module  or  assenably 
may  give  the  troubleshooter  an  indication  of  the  possibility  of  a  chronic 
problem.  Ey  accessing  engine  historical  data,  a  first  line  technician 
could  rapidly  isolate  a  troublesome  oenpenent  or  pert. 

Of  peranount  isportanoe  Is  the  fact  that  the  first  line 
technicians  must  always  maintain  their  tedtoiical  C9(pe3rtise  in 
troubleshooting.  Cie  prcpocad  expert  system  rust  never  be  more  than  a 
source  of  opert  or  ^iecific  maintenance  Infomation.  Decisions 
will  always  lie  with  the  technicians  and  their  supervisors. 

The  Second  Lavel  of  MalnteRincje 

Ihe  second  level  of  maintenance  carries  out  repair  of  major 
unservioeabilities  on  and  off  the  aircraft,  In-^tepth  ir^partions, 
r<^laosient  of  engine  modules,  and  engine  testing  in  the  Ehgine  Test 
Facility  (EEF) .  In  support  of  first  line  maintenance,  the  espert  system 
will  autcnatically  ootpara  lECSS  data  fault  signatures  with 
rectifications.  This  would  also  allow  the  second  line  technician  to 
investigate  the  details  suncunding  cases  where  the  actual  local 
rectification  differed  fretn  the  reocranendation  given  by  the  system.  It  is 
in  thi?  way  that  the  fault  library  can  be  validated  and  isproved. 
Kxhlenatic  oenponents  or  engirt  can  be  easily  highlighted  by  the  eipert 
lystem,  overocming  tediais  manual  searches,  and  case-by'<ase  analyses. 

Ihe  information  from  all  F404  maintenance  database  as  shown  in 
appendix  1  would  be  synthesized  lay  an  extension  of  the  proposed  expert 
system  at  secxnd  line.  Ihis  would  reveal  a  oonplete  overview  of  F404 
maintenance  activities.  Accurate  forecasting  of  maintenance,  overhaul, 
and  spare  parts  use  will  be  possible  given  the  information  available. 

Figure  2  is  a  schematic  di£sgram  of  the  various  oenponents  of  the 
F404  saintenanoe  ir.formation  systems  indicating  hew  tiiey  will  liaise  with 
the  proposed  expert  system. 


Developnent  and  ertianoesrierst  of  the  proposed  expert  system  wD  1 
be  initiated  throu^  engineering  activities  ongoing  at  third  level 
agencies.  For  exanple,  the  system  could,  from  a  develcproent  point  of 
view,  pxrvlde  occplete  and  vp  to  date  fleet  records  to  National  Defense 
Heatdquarters  and  the  Aerospace  Maintenance  Development  Unit  (AMCU). 
Studies  and  etvirormental  ccnpariscns  could  tt>en  be  possible  through  ad 
hoc  gjeries. 

cxaocBic^: 

An  expert  system  has  been  prc|X)sed  for  tlie  first  line  of  F404 
maintenance  in  the  CF.  First  line  technicians  vdll  xase  the  system  as  a 
source  of  additional  infomatioi  for  the  purposes  of  troubleshooting  the 
engines.  proposed  ejpert  systen  %rill  highlight  the  unique 

characteristics  of  Isa©  records  of  unserviceabilities  thus  promoting 
timely  and  accurate  diagnosis  and  repair.  Second  line  technicians  will 
find  the  nature  of  their  tasks  refocussed  towards  prcdjlem  or  subject 
engines  because  the  identification  of  these  will  be  greatly  facilitated  by 
the  esqpert  system.  Validation  of  the  .fault  signatures  will  ocxur  at  the 
second  line.  Ihizd  line  maintenance  and  develoEsaent  centres  will  support 
the  development  of  the  system  by  investigating  F404  fleet  data  to  develop 
and  isprove  fault  signature. 

Much  stands  to  be  gained  by  operators  znA  maintalners  alike, 
halving  a  system  wirich  can  prcmote  rapid,  reliable  troubleshooting  for  a 
fleet  of  fighter  engines.  The  proposed  system  VK»ld  be  a  true  advance  for 
oR-oondition  maintenance  in  the  hi^r-oost  business  of  modem  adrcraft 
naintenaixae. 


MoxKmmsBmns 

Bie  Chief  of  Research  and  Development  (CRAD)  Is  currently 
funding  Idle  developmmt  of  an  expert  systa«  r404  maintenance.  This 
paper  contains  the  Dipartment  of  National  Defense's  preliminary  concept  of 
that  system;  greater  detail  will  anerge  as  the  project  progresses.  Ihe 
discussions  with  Mr  B.l.  Forsyth  of  Ga^PS  Ltd  were  esctremely  helpful  in 
developing  this  work.  Ihe  liput  of  Hr  J.  Waring  at  the  Director  of 
Filters  and  Trainers  Engineering  and  Haintenanoe  is  edso  appreciated. 
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lte.^teis»spaceJWainten^^  unit 

\  lodger  unit  at  Canadian  Forces  Base  Trenton,  the  AMDU  is  the 
CF  centre  of  eagtertise  in  Engine  Perfoxmanoe  Monitoring.  Projects  include 
on-vdng  performance  traiding  and  engine  test  faciliiy  instruonentation 
nonitcaring.  The  technical  assistance  provided  in  the  developnent  and 
field  testing  of  the  First  Line  Troubleshooting  System  was  part  of  AMDU 
Projects  D4151E,  DOOISE,  and  I1135E. 


A  -  1 

ARPEKniX  1 

7404  MONIXm^Z  Dm  BASES 


AMMIS:  Aircraft  Maintenanoe  Kanagesnait  Infoona^oit  Systra:  the 

ijPTv»r-ai  data  base  used  thrcoghout  the  Air  Force  for 
reoardin^  loaintenance  infomtation. 


CW7  A  aaintenanoe  action  data  base  which  docaanents  field 
experlxioe  [2] 

EPL3S  Bwine  Parts  Life  TracSdng  Systan  provides  a  neans  of 
txaddng  Life  Ifeags  Indices  (lUls)  for  engine 
joaintenanoe  scheduling  [3] 

EM  '  Dwine  Perfcaasance  Monitoring  Systan  relies  OTlmrily  on 
data  provided  by  the  lEaS  and  the  Aubcciatic  ^ta 
AoouiHtion  and^Prcossasirg  Systaa  (AD^)  in  the  ETF. 

Ihe  following  six  prograss  mate  vp  this  suite  or 
8oft»are  [1]: 

a)  Ihe  Event  Plotting  program  gxMhically 
'  IECK5  data  for  the  tirsc  line  technician  to  refer 


IBCMS  data  for  the  first  line  technician  to  refer 
to  whai  troubleshooting; 

Iha  Mission  Analysis  progrOT  gra^c^lyA>r^^ 
low  frequency  dara  acquired  thrcurtioiAtm  fli^t 
for  a  limitea  namber  of  engine  and  fli^t 
parameters; 

Ihe  IWP  Code  program  trades  IMP  codes  by  aircraft 
tail  nunoer; 

Ohe  late-off  Analysis  program  preoe^^  w. 


warning  of  perfonnajxe  dsgradatJLon? 

Ihe  Tiate^ff  Trending  program  trends  td^sse  EHIs; 
and, 

EEP  'ttoubleshooting  program,  which  assists  in 

M J  — —  Wat*  rvy  rV5>^r%TTTiATV!t^ 


be  oenpared  to  knewn  fault  signa 
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4th  Sjmifwhm^9fishop 

APPUCATIGNS  OF  EXPERTS  SYSTEMS  IT.  DND 


PMQ  Wing$ttm»  Onuaiot  CciMufa 


A  DIAGNOSTIC  EXPERT  SYSTEM  FOR  DIGITAL  aRCUITS 
Capt  R.W.  Backlund'  and  Dr  J.D.  Wilson* 

Abstract 

.  This  paper  presents  a  sch^e  for  a  diagnostic  expert  system  which  is 
capable  of  trouble-shooting  a  faulty  digital  circuit  or  producing  a  reduced  test 
vector  set  for  a  non-faulty  digital  circuit  It  is  based  practical  fault-finding  logic 
and  utilizes  Al  techniques.  The  program  uses  expert  knowledge  compM-ised  of  two 
components:  that  which  is  corttained  within  ttie  program  in  the  form  of  rules  and 
heuristics,  and  that  which  is  derived  fran  tiie  circuit  under  test  in  the  form  of 
specific  device  information.  Using  both  forward  and  bacitward  tracking  algorithms, 
signal  paths  comprised  of  device  and  gate  interconnections  are  identified  from 
each  output  pin  to  the  primary  Input  pins  which  have  effect  on  them.  Beginning 
at  the  output,  the  program  proceeds  to  validate  each  device  in  each  signal  path  by 
forward  propagating  test  values  through  tite  device  to  the  output,  and  backward 
propagating  the  same  values  to  the  primary  inputs.  Ail  devices  in  the  circuit  are 
monitored  for  each  test  applied  and  their  performarrce  is  recorded.  Device  or  gate 
validation  occurs  when  the  recorded  history  shows  tiiat  a  device  has  been  toggled 
8u(%essfully  through  all  necessary  states.  When  run  on  a  circuit  which  does  not 
contain  a  fault,  the  program  determines  a  reduced  test  vector  set  for  that  circuit 


kkuhate  Studejit,  ^Pcx>feffior,  Dept  of  Eloctrioil  and  Gomputcr  EngiiMenng,  RMC,  KingsUo 
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Th«rtt  w«i*  A  tiLfM  whAii  fault-finding  alactronie  aqulpaiant  waa  a  atraight- 
forward  procaaa  which  tachniciana  could  accompli ah  uaing  logical  and 
Bsathodical  taating  procaduraa.  Thia  wac,  of  couraa,  back  whan  circuit  a  wara 
aloK^at  totally  accaaaibla  to  intruaiva  taating  tachnlquaa  throughout  thair 
aignal  patha.  Within  tha  laat  two  dacadaa  Frintad  Circuit  Boarda  (J^CBa) 
haaa  bacoma  axtramaly  complax  in  both  daalgn  and  oparation,  ac  that  today 
thay  ara  typically  aavaral  layara  daap  and  capabla  of  parforming  a  multituda 
of  conaacutiva  and  aaguantial  oporationa.  Not  aurpriaingly,  circuit 
accaaaLbility  haa  dwcraaaad  dramatically,  to  tha  point  whara  many  modam 
circuits  ara  accaasibla  at  faw  points  batwaan  thair  inputs  and  outputs*  As 
a  raault,  thasa  modarn  circuits  hava  bacoma  axtramaly  difficult,  and 
aoor^timaa  imposaibla,  to  diagnoaa  uaing  conventional  tachnician-oriantad 
mathods*  Tha  ganaral  trend  in  both  industry  and  tha  Canadian  Forces  haa 
bean  to  rely  lass  on  tha  technician  and  more  on  apacialixad  Automated  Teat 
Bquipmant  (ATi?)  for  FCB  diagnostics*  This  change  in  tactics  has  bean 
precipitated  by  tha  fact  that  technician-based  fault-finding  raguiraa 
conaiderabla  operating  raaourcas  whan  compared  to  FCB-spacific  ATE  ayetams, 
aapacially  in  the  areas  of  training,  tools  and  time  required  to  diagnoaa 
faults* 

ATBa  operate  in  a  ayatematic  fashion,  firing  through  a  pradaterminad 
pattern  of  testa  developed  by  domain  experts,  all  the  while  monitoring  the 
output  reaponaaa  of  the  circuit  under  teat.  The  patterna  of  testa  are 
referred  to  as  teat  vectors  and  ara  alaments  of  tha  comprahansiva  teat 
vector  aat  for  tha  circuit  which  ansuraa  that  all  devices  and  gates  ara 
verified  according  to  tha  detnain  expert* a  apacificatibna*  Onfortunataly, 
ATEa  ara  vaually  expansive,  as  there  ara  large  eoata  involved  in  tha  design 
and  development  stages*  One  reason  for  this  ia  that  a  considerable  amount 
of  design  tixaa  ia  spent  generating  the  teat  vector  aat,  since  it  ia 
important  that  tha  aat  be  correct  and  complata*  Aa  can  be  envisioned,  aa 
tha  circuit  becomes  more  complax  tha  niimbar  of  teat  vectors  required  also 
bacomas  larger.  Since  tha  number  of  poaaibla  teat  vectors  for  any  given 
circuit  ia  2*  for  JT  primary  inputs,  the  teat  vector  aat  grows  exponentially 
rather  than  linearly  for  the  number  of  inputs  to  tha  circuit*  Schemas  which 
can  generate  reduced  teat  vector  aata  ara  therefore  required  in  order  to 
limit  tha  time  and  raaourcas  spent  in  test  pattern  design  aa  wall  aa  in  tha 
diagnosis  of  tha  circuits  later* 

Another  shortcoming  of  ATSs  ia  that  substantial  coats  can  be  incurred 
later  in  thair  operational  lives  whan  syatam  modifications  ara  required  to 
accoosnodata  changes  in  hardware  and/or  software  of  unit  (a)  thay  teat*  This 
aituation  occurs  since  tha  teat  vector  sets  ara  circuit-specific,  and  apply 


uniquely  to  on#  typ«  of  circuit.  JUrtificiaX  Xntolliconco  (AX)  tochniquM 
offer  a  poaaible  aolution  to  thia  problm  by  introducing  intelliganca, 
through  the  utilization  of  rules  and  heuristica,  to  the  program's  generation 
and  application  of  test  vectors.  Such  rules  and  heuristics  can  ensure  that 
test  vectors  are  applied  in  a  logical,  as  opposed  to  random  or  sequential, 
fashion.  It  can  thus  be  possible  to  fault*find  a  given  circuit  using 
significantly  fewer  test  vectors  than  contained  in  the  comprehensive  test 
vector  set.  hi  techniques  can  also  ameliorate  the  reduced  test  vector 
generation  process,  obviously  a  critical  part  of  circuit  design. 

1%fo  basic  strategies  exist  with  respect  to  test  vector  generation! 
statistical,  or  pseudo-random,  test  vector  generation  and  algorithmic  teat 
vector  generation.  In  the  statistical  method,  a  circuit  ie  bombarded  by 
random  or  heuriatieally  chosen  test  patterns  which  are  added  to  the  test 
vector  set  if  and  only  if  they  enable  the  detection  of  a  previously 
undetected  fault  condition.  With  this  method,  those  faults  which  are  easily 
detected  are  located  fairly  rapidly,  while  those  which  are  more  difficult 
to  detect  require  increasing  computation  time.  An  upper  limit  may  have  to 
be  set  on  eomputatior.  time  or  the  number  of  test  vectors  comprising  the  test 
vef:tor  set  as  full  fault  coverage  may  require  exceaeive  computation  time. 
In  the  elgorithmic  method,  e  specific  algorithm  is  used  to  generate  a  set 
ot  teat  vectors  for  each  identified  fault  in  the  circuit.  Most  such 
algorithms  also  require  considerable  computation  time  and  may  contain 
redundant  tests,  as  no  record  is  maintained  of  other  device  performance 
during  e  specific  test  on  a  specific  device  or  gate.  Additionally,  neither 
of  the  above-mentioned  methods  attempt  to  handle  sequential  devices  such  as 
flip-flope,  latches  and  registers,  and  therefore  are  of  little  use  in 
diageoeirg  computer  interface  devices  or  mode  command  latches. 

Work  at  RMC  in  the  general  area  of  automated  fault-finding  was  begun  in 
1969  by  Capt  Ron  6oyce^^^«  In  hia  thesis,  presented  in  1990,  he  introduced 
e  FORTH  language-based  FCB  diagnostic  expert  system  for  use  wit  .1  the  CF. 
This  work  was  extended  by  Capt  R.E.  Leroux^,  when  in  May  1991  he  presented 
en  IBM  PC/AT-based  Data-Driven  Expert  System  (DDES)  for  FCB  diagnostics. 
This  eyatem  utilized  the  ORACLE  RDBMS  for  storage  of  expert  'knowledge*,  and 
need  a  C-based  'knowledge  processor*  to  manipulate  the  database.  A  plotter 
table  incorporating  a  mechanical  probe  permitted  automated  intrusive 
point-testing  anywhere  on  the  surface  of  the  FCB,  with  teat  date  acquired  * 
from  either  the  PCB'e  edge  connector  or  from  the  mechanical  probe.  Test 
data  was  processed  by  a  Burr-Brown  data  acquisition  board,  which  also 
controlled  test  signals  to  the  FCB.  Since  the  'expert  knowledge*  was  held 
in  e  database,  changes  to  thia  information  could  be  made  without 
re-compiling  the  entire  system,  unless  changes  were  made  to  the  data- input 


forms  (writtsn  in  SQL^TOmS).  Ths  systsm  could  bs  conflgursd  for  sithsr 
diagnostic  or  tsaching  purposss,  and  was  dsmonstratsd  on  a  KJB  %rhich 
incorporatsd  both  analog  and  digital  signal  procsssing  circuitry. 

m  DYIIASTXC  BXPSRT  SYSTEM 

Ths  DYNASTIC  (dynamic  diagnostic)  expert  systsm  prsssntsd  in  this  paper 
uses  ths  AI  techniques  of  forward  and  backward  chaining,  and  contains  expert 
knowledge  embedded  within  its  rules  and  heuristics.  It  is  capable  of 
trouble-shooting  a  digital  circuit  in  a  logical  manner,  using  heuristics  and 
rules  similar  to  those  which  a  human  trouble-shooter  might  use.  Although 
it  is  algorithmic  in  nature,  the  DYNASTIC  Expert  System  is  capable  of  both 
fault-finding  and  reduced  test  rector  set  generation.  Mhen  the  program  is 
run  on  a  faulty  circuit,  it  generates  sufficient  test  vectors  to  permit 
isolation  of  a  fault  by  validating  all  appropriate  circuit  devices,  from 
output  backwards,  in  the  faulty  signal  path.  Once  the  fault  is  located,  the 
program  indicates  the  device  which  must  be  replaced,  and  then  stops.  If 
mon  than  one  fault  exists,  the  program  can  be  run  again,  once  the  faulty 
devices  which  have  oeen  identified  have  been  replaced.  Since  the  DYNASTIC 
Expert  Systm  generates  only  enough  test  vectors  to  isolate  e  fault,  when 
it  is  run  on  e  circuit  which  doss  not  contain  a  fault,  it  will  continue  its 
search  through  all  paths  in  the  circuit,  ultimately  validating  all  devices 
in  the  circuit  and  generating  a  reduced  teat  vector  set  as  it  does  so. 

To  avoid  generating  duplicate  test  vectors,  the  DYNASTIC  Expert  System 
suiintains  e  history  of  node  values  for  all  devices  in  the  circuit  at  all 
timee.  The  program  will  test  a  device  with  a  test  pattern  only  if  that 
particular  pattern  has  not  been  applied  before,  either  as  s  direct  or 
indirect  result  of  tssting  psrforroed  on  the  circuit.  The  program  provides 
test-by-test  feedback  to  the  user  in  the  form  of  all  node  output  values,  the 
device  being  tested,  the  input  pattern  being  applied  to  the  device  under 
test,  and  devics  validation  as  it  occurs.  This  information  is  currently 
provided  in  scrolling  tsxt  format,  however  a  fully  developed  system  could 
present  this  information  on  a  graphical  display  of  the  circuit  under  test. 

Ths  DYNASTIC  Expert  System  uses  S-valued  logic  which  conuiats  of  two 
representation  for  logic  0,  F  and  f,  two  representations  for  logic  1,  T  and 
t,  aud  a  Don't  Cars  value  of  x.  A  STATIC  'F*  or  'T*  representation  is  used 
when  there  is  no  choice  as  to  ths  valus  which  must  be  applied  at  an  input 
pin  of  a  device,  and  a  NON-STATIC  *f*  or  *t'  representation  is  used  when 
there  ie  a  choice*  STATIC  values  originate  as  components  of  the  main  test 
pettsm  which  is  beir.g  applied  to  a  particular  device  to  validate  it,  and 
are  then  propagated  backwards  to  the  primary  inputs.  As  an  example,  in  "Fig 
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Fl^uM  It  5-VaIue  Logic  Represent at ion 

1*  itRHDlR  la  boing  tastad  with  tha  pattern  *2*  7  f*.  Tha  values  which 
eonq^iaa  thia  teat  pattern  are  STATIC  since  they  cannot  be  changed  without 
changing  tha  vary  nature  of  tha  teat*  Tha  static  *T*  value  on  pin  1  of 
UMOIA  ia  bac)cward*propagatad  through  pin  3  of  XORIA,  where  an  input  pattern 
of  either  *t  /*  or  'ft*  will  satisfy  the  output  requirement.  Since  there 
le  laore  than  one  way  to  achieve  the  required  gate  output y  the  input  values 
are  jroir«*STATXC.  The  static  'T*  value  on  pin  2  of  RANDIA  ie  backward-- 
propagated  through  pin  3  of  ORIA.  To  satisfy  its  output  requirement,  ORlA's 
input  pattern  can  be  either  *c  ar*  or  *r  t*,  where  x  can  be  either  't*  or 
*f' •  Again,  since  there  ie  more  than  one  way  to  achieve  the  required  gate 
output,  the  't*  input  value  is  trofJ^STATIC  as  is,  of  course,  the  'x*  value. 
The  static  *T*  value  on  pin  13  of  NAm)lA  is  backward-propagated  through  pin 
3  of  AHOIA,  where  the  only  possible  input  pattern  which  will  produce  the 
required  gate  output  is  *T  T*.  Both  of  ANOlA's  input  values  are  therefore 
STATIC.  The  STATIC  and  HOR-STATIC  values  on  the  input  pine  of  XORIA,  ORIA 
and  AMOIA  are  backward-propagated  in  a  similar  fashion  through  other  devices 
in  the  signal  path  until  the  primary  input  pins  are  r^Ached. 

Circuit  information  oust  be  supplied  to  the  DYNASTIC  Bx|>ert  System  in 
the  form  of  a  specially  formatted  net  list.  At  present,  this  net  list  is 
supplied  through  ORCAD,  which  is  also  the  circuit  development  environment. 
The  netlist  can,  however  be  manually  produced  on  a  standard  word-processor, 
or  alternately  could  be  supplied  by  the  manufacturer  of  a  particular  PCB  or 
device.  The  DYNASTIC  Expert  System  analyzes  the  netlist  information  for  the 
circuit,  and  from  it  identifies  all  primary  inputs  and  outputs  and  pin 
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d#®ignationt.  It  than  uaaa  a  back-tracking  algorithm  to  datarmina  tha 
signal  paths  from  aach  output  pin  back  to  tha  primary  input  pins  which  hava 
affact  on  it*  Davica  intar-connoctions  are  logged  as  tha  program  proceeds 
along  aach  path*  Onca  tha  signal  paths  hava  bean  idantifiad,  tha  program 
chooses  the  signal  path  containing  tha  largest  number  o£  primary  inputs  and 
tha  largest  number  of  gates  and  begins  to  diagnose  it.  By  choosing  the 
longest  path  first,  tha  program  affectively  tests  tha  maximum  number  of 
devices  at  the  same  time,  since  alternate  teat  patterns  will  concurrently 
appear  on  the  input  pins  of  other  devices  while  any  single  device  is  being 
validated*  These  particular  test  patterns  will  not  have  to  be  applied  again 
whan  it  is  time  to  validate  these  other  devices* 

working  from  tha  output  backwards,  aach  device  or  gate  in  the  signal 
path  is  in  turn  validated  by  applying  on  of  tha  required  test  patterns  for 
that  davica  if,  as  mentioned  above,  that  particular  test  pattern  has  not 
appeared  on  the  device's  input  pins  before  as  an  indirect  consequence  of  a 
test  on  another  device.  The  test  patterns  are  backward-propagated  to  the 
appropriate  primary  input  pins,  and  forward  propagated  to  the  output*  As 
shown  in  "Fig  2a",  at  some  point  in  the  backtracking  process,  it  is  possible 
that  a  particular  input  pattern  for  a  device  will  require  input  patterns  in 
devices  before  it  in  tha  signal  path  which  cannot  possibly  occur 
concurrently*  If  such  a  contention  of  signals  occurs,  a  conflict  resolution 


Figure  2:  Example  conflict  resolution  process 
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Algorithm  ia  appliod  to  th«  circuit  which  back-tracaa  to  tha  aourca  of  tha 
conflict  and  appliaa  rulaa  and/or  hauriatica  to  raaolva  it*  Tha  algorithm 
than  indicataa  to  tha  main  program  whara  to  rasuma  bac)cward--propagation,  aa 
indicatad  in  "Fig  2b"*  If  a  taat  cannot  poaaibly  ba  eonductad  dua  to  tha 
phyaical  intarconnactiona  of  tha  circuit,  tha  DYNASTIC  Sxpart  Syatam 
idantifiaa  tha  particular  davica  which  could  not  ba  fully  validatad,  and 
indicataa  tha  invalid  taat  pattarn.  In  "Fig  3",  a  conflict  ia  craatad  at 
tha  intar^eonnactad  input  pins  of  MORIA  and  NAKDIA  by  tha  raquirad  taat 
pattarn  *T  F*  baing  backward  propagated  from  tha  input  pina  of  OEVICB  X* 
Sinca  this  conflict  ia  unraaolvabla,  tha  taat  pattarn  *T  F*  ia  conaiderad 
invalid  for  DEVICS  X*  Fortunately,  aoma  of  tha  2^  taat  pattarna  ara 
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Figura  3t  Example  non*valid  taat  pattarn 

redundant  for  many  davicas,  and  so  a  davica  can  still  ba  validated  even 
though  all  possible  input  combinations  ara  not  axarcisad*  To  more  fully 
understand  this  concept,  a  look  at  tha  internal  construction  of  a  logic 
davica  is  raquirad*  "Fig  4"  shows  a  2-* input  CKOS  AND  gate*  Internal 
construction  for  T7L  and  other  types  of  AND  gates  is  similar  with  the 
exception  of  tha  type  of  transistors  utilized  and  tha  types  of  input  and 
out^t  buffering*  As  can  ba  seen  in  "Fig  4",  if  either  Input  1  or  Input  2 
ara  low,  transistor  Q2  will  ba  cut-off  and  transistor  QS  will  be  turned-on. 
Inputs  1  and  2  therefore  need  not  ba  low  at  tha  same  time,  aa  this  will 
offer  no  new  information  about  tha  circuit*  The  2-input  CMOS  AND  gate  thus 
requires  the  test  patterns  *r  *F  3"  and  *7  7'  to  validate  it,  and  test 
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rigura  4 I  Internal  construction  of  a  CKOS  AKD  gata 

pattern  r*  is  superfluous.  Likewise  for  a  3-^input  CMOS  AMD  gate,  the 
teet  patterns  M*  T  T* ,  F  T\  r  ,  and  *r  r  /*  are  absolutely  required 
for  device  validation,  and  the  rest  of  the  2^  possible  input  combinations 
are  superfluous.  This  principle  applies  to  all  AMO  gates  regardless  of  the 
number  of  inputs,  with  (where  n»number  of  inputs)  test  patterns  being 
absolutely  required  for  device  validation.  This  type  of  test  pattern 
reduction  can  also  be  applied  to  logic  MAND,  OR,  and  MOR  gates,  with 
test  patterns  required  for  validation  of  these  devices.  The  DYNASTIC  Expert 
System  generates  device  test  patterns  based  on  this  knowledge  of  device 
behaviour. 

Once  all  conflicts  have  been  resolved  and  all  logic  values  have  been 
determined  for  a  particular  path,  the  circuit  primary,  inputs  are  forward*- 
propagated  to  the  circuit  outputs.  They  are  then  verified  as  either  correct 
or  incorrect  by  comparing  them  to  the  physical  circuit *s  actual  outputs. 
As  mentioned  above,  if  the  circuit  does  not  contain  any  faults,  the  program 
will  generate  a  set  of  test  vectors  which  will  validate  all  devices  and 
which  will  be  non-redundant.  This  set  of  test  vectors  can  then  be  stored 
in  a  library  of  such  test  vectors  and  used  for  analysis  of  similar  circuits 
when  they  occur  as  sub«-sets  of  larger  circuits. 

Xf  at  any  time  during  testing  one  or  more  of  the  outputs  of  the  physical 
circuit  do  not  agree  with  the  DYNASTIC  Expert  System-generated  values,  the 
program  goes  into  a  fault  isolation  mode  and  proceeds  to  isolate  and 
trouble-*shoot  the  indicated  faulty  path  from  output  to  input.  While  in  this 
fault-isolation  mode,  if  a  faulty  output  value  is  indicated  the  program 
attempts  to  further  isolate  the  source  of  the  fault  by  seeking  alternate 
routes  within  the  path  through  which  it  can  verify  the  current  device-under- 
teiit.  Additionally,  alternate  signal  paths  (feeding  different  outputs) 
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«^ieh  contain  the  eurront  dovico-undor-'test  ara  Invaatigatad,  with  tha 
currant  taat  pattarn  baing  propagated  through  to  thaaa  diffarant  outputs • 
Xf  thaaa  taata  fallf  tha  currant  davica-undar-taat  auat  ba  conaidarad  to  b# 
pcjaibly  raaponalbXa  for  tha  fault  condition*  All  davicaa  eonnactad  to  its 
inputs  ara  than  validated,  if  possible,  using  tha  above  mentioned  fault- 
isolation  procedures*  As  many  devices  as  possible  ara  validated  before  tha 
program  finally  produces  a  list  of  tha  davica<8)  which  may  ba  rasponaibla 
for  tha  partioalar  fault  condition* 

for  an  initial  test  of  tha  DYNASTIC  Expert  System,  tha  4-bit  full-adder 
circuit  of  "Fig  5»  was  salactad*  This  circuit  is  similar  in  construction 
to  tha  74LS83/74LS283  chip,  and  so  praaantad  an  easily  verified,  non-trivial 
test  environment.  A  full  mock-up  using  M  TTL  components  was  used  to 
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simulate  faults,  with  an  actual  74LS83  chip  uaad  aa  a  rafaranca.  Tha 
comprehonalva  taat  vactor  aat  for  this  circuit  la  or  912*  Tha  DYNASTIC 
Expart  Syatam  datarmlnad  that  a  total  of  7  taat  vactora  wara  raqulrad  to 
fully  taat  all  davlcaa  In  thla  circuit  <saa  **TabIa  I”)*  Of  tha  ?  vactora 
ganaratadf  nona  wara  redundant#  and  all  gates  In  tha  circuit  ware  validated. 
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Table  It  Eaducad  Test  Vector  Sat  for  4-Blt  Eull-Addar  circuit 

fault  alnrulatlon  haa  only  recently  been  attempted  on  a  limited  acala# 
with  encouraging  results.  As  an  example#  a  stuck*-at«-0  fault  was  simulated 
m  m  of  tL^  4-blt  full-adder  circuit.  The  DYNASTIC  program  generated  17 
taat  vectors  before  Isolating  tha  fault  to  either  of  davlcaa  AKD2C  or  NOE2A# 
both  possible  culprits  for  this  particular  fault*  A  stuck-at-1  fault 
slskulated  on  N19  required  17  test  vectors  to  Isolate  It  to  either  of  devices 
AKD2A  or  ZHVID#  again#  both  possible  culprits  for  this  particular  fault. 
Zn  both  examples  above#  tha  DYNASTIC  Expert  System  verified  that  there  wara 
no  other  devices  Involved  In  the  particular  fault  by  validating  them  through 
alternate  signal  routes  and  signal  paths* 

fUTDEB  WORE 

Work  is  presently  underway  which  will  give  the  DYNASTIC  Expert  System 
the  capability  to  fault-find  sequential  devices,  such  as  flip-flops#  latches 
and  shift  registers.  An  improved  user  Interface  Is  planned  which  will 
include  mouse#  icon  and  keyboard  input#  and  a  graphic  display  of  the  circuit 
being  tested.  The  DYNASTIC  Expert  System's  progress  will  then  be 
graphically  displayed  on-screen  as  the  circuit  is  processed*  An  improved 
fault- location  algorithm  is  being  developed  which  will  allow  faster 
identification  of  a  fault  condition.  A  library  system  containing  test 
vector  sets  for  commonly  used  sub-circuits  is  planned*  This  library  system 
will  allow  the  program  to  treat  such  sub-circuits  as  self-contained  devices 
which  can  then  be  quickly  validated  with  the  pre-determined  test  vector 
sets*  The  test  vector  generation  and  fault-finding  processes  for  large  and 
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coaplM  circuits  should  thus  bs  spssdsd  up  considsrsbly.  It  is  also 
snticipstsd  that  automatic  data  ac<iuisition  and  signal  gsnsration  can  ba 
incorporated  into  tha  DYNASTIC  Expert  System,  so  that  a  circuit  can  be 
connected  to  the  program  and  diagnosed  automatically  without  user 
intervention.  This  mode  of  operation  will  bo  in  addition  to  the  present 
manual  stode,  which  can  then  be  configured  for  instructional  purposes. 

OOHCLDSIOHS 

The  DYNASTIC  Expert  System  was  developed  with  the  intent  of  emulating 
practical  trouble-shooting  techniques.  To  this  snd,  it  has  been  successful. 
As  an  indirect  result  of  the  implementation  of  this  methodology,  it  has  been 
shown  that  the  program  is  also  capable  of  generating  reduced  test  vector 
sets  for  the  circuits  analysed.  The  program  is  still  under  development  and 
so  has  limitations  to  the  types  and  sizes  of  circuits  it  can  diagnose, 
however,  the  expert-based  methodology  implemented  should  prove  to  be 
appropriate  to  almost  any  type  of  digital  circuit. 
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Abstract 

Today's  military  commander  is  faced  witii  a  complex  and  uncertain  world. 
Artificial  intelligence  <AI)  systems,  specifically  knowledge-based  or  expert  systems, 
are  currattly  being  developed  as  a  means  of  pmviding  intelligent  assistance  to  a 
variety  of  military  problems.  From  the  perspective  of  frie  Defense  Advanced 
Research  Projects  Agency  of  the  US  Department  of  Defense  (DARPA)  •.»  we 
stand  at  die  direshold  of  a  new  generadon  of  computer  technology  having 
unprecedented  capabilfties”.  However,  as  evidenced  by  practical  experience,  die 
realization  of  these  capabilities  is  contingent  on  the  management  of  uncertainty. 

This  paper  surveys  the  principal  approaches  used  to  manage  uncertainty, 
in  knowledge-based  sy^ems  and  examines  their  implications  from  a  military 
perspecttve. 
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Introduction 


That  the  world  is  a  complex  and  changing  place,  fraught  with  uncertainty 
and  risk,  should  come  as  no  surprise  to  anyone.  The  military  professional  is  well 
aware  that  perceptions  can  be  incorrect,  and  that  it  is  seldom  possible  to  know 
what  tomorrow  will  bring  (e.g.,  the  recent  history  of  the  Soviet  Union).  However, 
it  is  equally  clear  that  selecting  a  course  of  action  in  an  effort  to  solve  a  given 
problem  (e.g.,  dealing  with  what  Mr.  Baker  refers  to  as  the  "loose  nuke"  problem), 
is  influenced  by  available  knowledge,  and  that  mistakes  in  the  processing  of  this 
knowledge  are  often  attributable  to  human  errors  [2-4]. 

The  advent  of  the  computer,  during  the  20th  century,  raised  hopes  that  an 
inielligent  machine  could  be  developed  that  would  overcome  these  human 
limitations,  and  would  bo  capable  of  providing  tiie  answers  to  many  (if  not  all)  of 
the  problems  faced  by  mankind.  Research  aimed  at  producing  such  an  intelligent 
machine,  fuelled  by  dreams  of  space  travel  and  the  desire  to  build  ever  more 
efficient  weapons  of  war,  has  focused  on  Al  work  related  to  knowledge-based 
systems.  This  research,  which  has  grown  exponentially  during  fae  last  decade  [5, 
6],  has  resulted  in  a  number  of  important  advances.  Howfever,  important  design 
issues  remain,  and  "uncertainty  management  is  a  case  in  point  [7,  p.  29]". 

Few  questions  have  led  to  so  much  argument  and  so  little  enlightenment 
as  the  question  "What  works?"  in  the  management  of  uncertainty.  A  review  of  the 
literature  reveals  the  existence  of  a  multitude  of  approaches  for  representing  and 
reasoning  with  uncertain  information  [7-12],  and  the  absence  of  an  accepted 
methodology  for  implementing  this  technology  [13-21].  This  paper  provides  an 
overview  of  the  uncertainty  management  problem,  and  examines  the  implications 
of  this  technology  from  a  military  perspective  [22-31],  by  reviewing  how  Bayesian 
belief  networks  can  be  applied  to  a  military  classification  problem  [32-38]. 


Uncertainty 


Uncertainty,  which  is  an  inexact  concept,  can  be  affected  by  information  that 
is:  uncertain,  incomplete,  or  inconsistent  [2, 31;  or  by  heuristics  which  inaccurately 
describe  relationships  between  different  pieces  of  information  [111.  EJoth  the 
reasoning  process  and  knowledge  can  be  affected  by  uncertainty,  and  errors  that 
occur  when  information  and/or  heuristics  are  combined  in  an  effort  to  discover  new 
knowledge  (such  as  tiie  process  of  problem  solving  (13, 14])  can  complicate  this 
situation.  Uncertainty  is  typically  explained  through  the  use  of  Informal 
explanations  and  examples  (111,  and  this  paper  examines  the  question  of 
uncertainty  through  the  eyes  of  a  soldier  who  must  decide  whether  to  attack  or 
welcome  an  unidentified  agent  (Figure  1). 


Knowledge-Based  Systems 


Knowledge-based  systems  are  computer  systems  that  consist  of  a 
knowledge  base,  and  a  knowledge  base  manager  [16].  Although  this  technology 
is  still  evolving  and  no  standard  architecture  has  yet  emerged  [15],  knowledgo- 
based  systems  typically  operate  In  a  cooperative  environment  (Rgure  2). 


Figure  2.  The  Knowledge-Based  System  Environment 

The  development  of  knowledge-baseu  technology  can  be  traced  to  a 
number  of  events  during  the  late  1970s  and  early  1980s,  many  of  which  were 
motivated  by  military  interest  in  intelligent  reasoning  systems  [10].  This  research 
led  to  the  fielding  of  a  variety  systems  which  were  widely  embraced  in  the  belief 
that  they  would  lead  to  tremendous  economic  payoff  [15].  Although  this 
technology  has  led  to  dramatic  changes  throughout  the  industrialized  world  [17-20], 
these  systems  iack  a  number  of  important  capabilities  [10].  Efforts  aimed  at 
overcoming  these  limitations  have  focused  on  the  management  of  uncertainty,  and 
have  led  to  the  development  of  a  multitude  of  approaches  for  the  management  of 
uncertainty  [11].  What,  then,  are  these  uncertainty  management  cpproaches? 


Uncertainty  Management  Approaches 


Uncertainty  management  approaches,  which  span  the  spectrum  from  ad  hoc 
programming  solutions  to  formal  representational  languages  complete  with 
mathematical  proofs,  encompass  a  multitude  of  techniques  designed  to  deal  with 
uncertain,  incomplete,  and  inconsistent  information  [111.  Although  an  examination 
of  alt  cf  these  approaches  is  clearly  beyond  the  scope  of  this  paper  (Note  3),  the 
rationale  for  selecting  a  specific  formalism  can  be  articulated  aoxirding  to:  die  type 
and  strucbjre  of  information  to  be  processed,  task  type,  and  the  development 
framework.  Each  of  these  issues  is  discussed  briefly  prior  to  examining  what  Is 
done  in  practice,  and  working  through  an  example  using  Bayesian  belief  networks. 

Type  and  Structure  of  Information 

The  type  suid  structure  of  information  that  is  avaiiable  to  be  processed  by 
knowledge-based  systems  can  broadly  be  classified  as  either:  numeric 
(quantitative},  or  non-numeric  (qualitative)  information.  For  this  reason  a  number 
of  different  uncertainty  management  approaches  have  been  developed,  and  can 
be  classified  as  eithsn  numeric  or  non-numeric  methods,  according  to  the  type  and 
structure  of  the  information  that  they  are  designed  to  process  (Table  1). 


Table  1.  Uncertainty  Management  Formalisms 


1  Numeric  Methods 

Non-Numeric  Methods  j 

1  One-Valued  Quantitative  Formalisms 

1  Baye's  Theory,  Belief  Networks... 

Multivalued  Logics  I 

Modal  Logic,  Default  Logic,...  | 

1  Two-Valued  Quantitative  Formalisms 

I  Dempster-Shafer  Theory... 

Heuristic  Techniques  | 

Endorsements... 

1  Set-Valued  Quantitative  Formalisms 

1  Fu22y  Set  Theory... 

Biological  Processes 

Neural  Networks 

Although  much  of  the  uncertainty  literature  appears  to  be  preoccupied  with 
a  debate  over  which  uncertainty  management  approach  is  the  ‘best" ,  there  is  a 
growing  body  of  evidence  which  argues  that  a  more  open-minded  ap^oach  is 
required  [8, 11].  This  integrative  approach,  which  is  based  on  ttie  contention  that 
different  types  of  uncertainty  can  most  efficiently  be  managed  by  employing  a 
framework  of  different  uncertainty  management  approaches,  is  closely  associated 
with  research  aimed  at  decomposing  application  problem  domains  according  to 
gen«ic  task  types. 

Knowledoe-Based  System  Task  Types 

Knowledge-based  systems  have  been  applied  to  a  number  of  different 
problem  domains  (DIALOG  employs  18  subject  descriptors  [6D;  however,  an 
analysis  of  these  applications  reveals  the  existence  of  a  number  of  generic  task 
types  (Figure  3).  This  approach  is  based  on  the  belief  that  there  is  no  one  *besf 
method  of  managing  uncertainty,  that  different  problem  types  involve  various  types 
of  uncertainty,  and  that'  die  determination  of  an  appropriate  uncertainty 
management  approach  is  dependent  on  the  type  of  task  [8]. 


Figure  3.  Taxonomy  of  Expert  Systems  •  By  Type  of  Task  {9,  p.  10] 


The  development  of  knowledge-based  systems,  capable  of  supporting  die 
complex  requirements  of  dynamic  largo  scale  problems,  has  led  to  the  adoption 
of  new  methodologies,  architectures,  and  system  development  tools  [10,  11]. 
Although  standards  are  still  evolving,  these  next-generation  frameworks  typically 
pemnit  the  selection  of  appropriate  uncertainty  management  approaches  in 
accordance  with  task  type  requirements,  and  emphasize  modular  construction. 
Where  reusable  component  parts  designed  to  efficiently  solve  specific  tasks  (e.g., 
the  IFF  problem),  can  communicate  to  cooperatively  solve  problems  (Rgure  4). 


Figure  4.  Cooperative  Frameworks  for  Knowledge-Based  Systems 

Although  the  rationale  for  adopting  a  cooperative  framework  can  be 
demonstrated  at  a  conceptual  level,  the  most  convincing  arguments  for  a 
cooperative  approach  come  from  a  comparative  examination  of  single  and  multiple 
comixjtatlonal  models  [11].  This  is  accomplished,  in  the  following  section,  by 
examining  the  implemented  system  literature. 
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Implemented  Systems 


Implemented  systems,  which  can  appear  In  many  different  shapes  and 
sizes,  have  been  defined  as  computer  based  systems  that  are  capable  of  solving 
or  assisting  In  the  solution  of  practical  problems  (1 1].  Although  a  cursory  review 
of  the  literature  could  lead  one  to  believe  that  only  a  handful  of  implemented 
knowled{^based  systems  exist  [21],  numerrxjs  applications  can  be  found  [6]. 
Theso  ^plemented  systems  have  had  a  dramatic  effect  on  manufacturing 
processes  [17-20],  and  there  is  a  general  sense  that  this  t^hnology,  which  is  still 
evolving  [10],  has  been  accepted  as  a  must  have  in  the  commercial  sector  [15]. 
What,  then,  is  this  technology,  and  what  capabilities  does  it  possess? 

First.  Second  and  Next-Generation  Systems 

A  review  of  the  implemented  system  literature  reveals  the  existence  of 
several  competing  knowiedge-t^sed  system  technologies,  whk:h  can  generally  be 
differentiated  by  their  architecture  and  capabilities  [1 1].  For  illustrative  purposes 
(not  to  be  construed  as  a  definitive  classification),  these  technologies  can  be 
categorized  as  first,  second  and  next-generation  systems  (Table  2). 


Table  2.  Knowledge-Based  System  Technologies 


Rrst 

Second  Gisnsi-atioW  •  j 

•  Najct-C^neration  ■ , 

1  Anrfiitecture ' 

Rule  Based  (18] 

Reasoning  or  Control 
Strategies  are 

Explicitly 

Represented  (18] 

Integrative  with 

Multilevel  Modular 
Components  (10] 

1  System  •. 
i  CapetKiifies 

-Scaffr.'  ■■  ■'  • 

•  Stand-alone 
Systems  for  Solving 
Small  Static 

Problems  (10, 18] 

-  Stand-alone  or 
Integrated  Systems 
for  Smalt/Medium 
size  Problems 

•  Cooperative  Real¬ 
time  Solution  of 

Dynamic  Large-Scale 
Problems 

-Manasement 
of  Uncertainly 

•  Rigid  (add  on) 
techniques  for  the 
management  of 
uncertainty  (11] 

-  Sophisticated 
Uncertainty 
Management 
Approaches  (18] 

-  Multiple  Uncertainty  1 
Management  I 

Approaches  (10]  1 
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implications:  A  Military  Perspective 


The  application  of  knowledge-based  system  technology  to  military  problems 
is  an  ongoing  and  important  endeavour.  Anyone  who  doubts  this  estimate  of  the 
situation  need  only  review  the  events  of  the  Gulf  War,  which  was  an  Information 
war  [251,  and  take  the  time  to  piece  together  how  much  of  the  war  was  directly 
influenced  by  knowledge-based  systems  [25,  26],  These  systems  had  a  major 
operational  impact  on  transportation  planning  [1],  were  instrumental  in  planning  air 
strikes  [29],  provided  commanders  with  unprecedented  command  and  control 
networks  [25],  and  enhanced  combat  effectiveness  through  the  provision  of  near 
real-time  information  [26].  In  short,  knowledge-based  systems  have  been  applied 
to  most  of  the  component  parts  of  the  military,  and  this  technology  has  the 
potential  to  affect  the  entire  military  f»-oblem  domain  (Figure  5). 


Figure  5.  The  Military  Problem  Domain 
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In  an  faicreasingly  complex  world,  where  accuracy  and  the  requirement  to 
process  an  exploding  mass  of  information  make  computers  a  fact  of  life, 
automated  systems  pose  both  an  opportunity  and  a  threat  [25].  This  is  not  to  say 
that  knowledge-based  systems  offer  a  panacea  for  all  military  problems,  or  that 
failures  have  not  occurred  [30].  However,  there  is  ample  evidence  to  suggest  that 
this  technology,  where  wisely  applied,  can  lead  to  a  more  ef^cient  and  effective 
military,  as  discussed  in  the  following  case  study  of  the  Bayesian  Reasoning  Tool. 

The  Bayesian  Reasoning  Tool:  A  Case  Study 

The  Bayesian  reasoning  tool  (BaRT),  is  a  knowledge-based  system  that  Is 
currently  under  development  at  the  Naval  Research  Laboratory  (NRL), 
Washington,  as  an  aid  in  classification  f^-oblem  solving  [24, 33, 34].  A  case  study 
of  BaRT  was  conducted,  and  forms  part  of  this  paf^r  for  three  reasons;  first,  BaRT 
has  been  successfully  applied  to  two  military  problems  (classifying  ship  Images, 
and  analyzing  Intelligence  reports  [24]);  sectHidfy,  BaRTs  architecture  permits 
stand-alone  or  cooperative  operation  (Rgure  6);  and  last,  but  not  least,  a  wealth 
of  information  on  BaRT  was  available  torough  the  XTP-4  research  community. 


Figure  8.  BaRT  System  Architecture  Modification  of  24,  p.  277] 
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Background 

BaRT  was  originally  developed  as  a  prototype  ship  classification  aid,  which 
is  a  complex  problem  that  can  have  life-and-death  consequences  (see  [24]  for  a 
discussion  of  this  problem).  Initial  work  was  based  on  the  PROSPECTOR 
updating  method,  and  a  representative  subset  of  10  naval  classes  was  selected 
from  the  600  -f  naval  classes  that  comprise  the  operational  environment 
Extensive  testing,  by  Navy  experts,  clearly  demonstrated  this  system’s  capabilities, 
which  were  judged  to  be  excellent  (using  realistic  test  images  [24]).  As  a  result 
of  this  success,  BaRT  was  subsequently  modified  to  meet  operational  Navy 
requirements,  and  the  most  recent  version  of  BaRT  supports  three  different 
uncertainty  management  approaches:  Bayesian  networks,  influence  diagrams,  and 
taxonomic  hierarchies  [33].  This  version  of  BaRT  was  also  tested,  using  the  same 
test  data  as  the  original  prototype,  and  almost  identical  test  results  were  obtained 
using  a  less  complicated  model  (a  36  node  network  with  35  links,  compared  to  the 
PROSPECTOR  version  which  required  181  nodes  and  297  links  [24]). 

Bayesian  Belief  Networks 

Belief  networks  are  one  of  the  formalisms  that  have  been  proposed  for  the 
management  of  uncertainty  that  are  considered  appropriate  for  hierarchical 
classification  problems,  and  these  networks  form  an  important  component  of  the 
knowledge  representation  and  reasoning  schemes  in  BaRT.  Although  a  number 
of  different  Bayesian  network  approaches  exist  (variously  referred  to  as  influence 
diagrams,  causal  nets,  belief  nets,  knowledge  maps,  relevance  diagrams,  and 
Bayesian  networks  [11, 35]),  the  approach  implemented  in  BaRT  is  based  on  the 
contention  that  hypotheses  and  relations  in  a  given  domain  can  be  represented  in 
a  network  of  low  order  probabilistic  relationships  between  clusters  of  semantically 
related  hypotheses  [36].  These  networks  consist  of  a  set  of  exhaustive  and 
mutually  exclusive  hypotheses,  which  are  quantified  with  numerical 

values  that  indicate  the  degree  of  belief  accorded  to  each  hypothesis  by  some 
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body  of  knowledge  K.  This  is  illustrated  in  Rgure  7  using  the  IFF  problem  as  an 
example  (see  [11]  for  a  detailed  discussion),  where  A;  represents  the  statement 
•tfie  approaching  unidentified  agent  is  hostile,*  and  TQti  1^:)  denotes  the  subjective 
belief  h,  given  a  body  of  knowledge  K  (which  is  influenced  by  the  set  of 
hypotheses  H  »  \h„  hj,  hj,  k^).  The  links  between  the  nodes,  which  are 
outlined  in  Table  3,  indicate  causal,  probability,  relationships.  To  fully  specify  this 
network  eleven  conditional  probability  values  are  required,  instead  of  flie  standard 
2"-1«31,  due  to  the  Bayesian  network  independence  assumption  [11]. 
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Figure  7.  Directed  Graph  (or  the  iFF  Domain  Model 


Table  3.  Conditional  Probabilities  for  Figure  7 


Attribute 


V{hi\h,) 

T(Hs\h,) 

Tihj\-h,) 

tP(A,|A,AAj) 

A 

A  Aj) 

y(A,|-A,  A  -A,) 

1P(A,|AP 

3>(A,|-A,) 


Value _ Explanation 

0.20 _ Current  intelligence  estimate _ 

0.80  Improper  electronic  id  is  uncommon, 

0.20  but  frequent  if  agent  is  hostile 

0.20  Erratic  flight  is  rare,  and  uncommon 

0.05  consequence  of  hostile  agent 

0.80  Absence  of  radio  contact  is  rare,  but 
0.80  frequent  if  either  improper  electronic 
0.80  id  or  erratic  flight  present 
0.05 _ _ 

0.80  Decreasing  altitude  is  common,  but 

0.60  frequent  when  flight  is  erratic 


/ 


^cvr^'r^ 

BBJ 

i<?¥;.y’./‘^ 

'‘1 

5r  {"->r  ’  ,<V; 

gt?J 

m .  :■? 


p.#>l  -''J 

» '''‘:^^/  V:V- '•: 


lf;a 


i* 


Once  the  causal  relationships  between  the  hypotheses  that  tom  the  domain 
model  illustrated  in  Rgure  7  have  been  identified  (Table  3),  this  information  can  be 
represented  in  an  undirected  graph  (Rgure  8),  composed  of  a  number  of  cliques 
{h„  hj,  h),  {hj,  hp  h},  and  \hj,  which  are  assumed  to  be  independent  of  all 
those  hypotheses  that  are  not  adjacent,  conditional  on  those  hypotheses  that  are 
adjacent  [36,  38].  These  hypotheses  are  specified  by  the  marginal  distributions 
derived  from  the  conditional  probabilities  shown  in  Table  3,  according  to  (1),  as 
illustrated  by  (2)  and  (3),  and  are  stored  in  Table  4  for  future  reference. 

JP(A;A/rysAjA/ir/AP  «  !P(A.aAc)  .  .  IPOti^y^j)  (1) 

3>(Aj)  3»(AysA^ 

» y{Hi\h,)  yQtj\h,)  y{h,)  »  0.8  X  0.2  x  0.2  -  0.032  (2) 

OH-AjaA^nAj)  »a>(A,i -a,)  VQij  1  -A/)  OH-A,)  -  0.2  x  0.05  x  0.8  =  0.008  (3) 


Figure  8.  Undirected  Graph  for  the  IFF  Domain  Model 


Table  4.  Marginal  Distributions  on  the  Cliques  of  Figure  8 


Clique  (A;,  hp  Aj _ Clique  \hj,  A„  h) 

JKA/aA^aAj)  « 0.032  IP(AyvAjAA^  « 0.032 
y(-A;AAyvA,)  « 0.008  JK-AyvAyvA^  -0.032 


Total  ■  1.(XK) 


Total  a  I.OCK) 


Clique  (A,,  Aj 
JKAjaAj)  « 0.064 
y(“AyvAf)  a  0.552 

Total  >  1.000 
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From  Table  4,  prior  probabilities  for  each  hypothesis  can  be  derived  (i.e., 
Vihs)  -  TttysA,)  +  OK-AysA^  -  0.064  +  0.552  -  0.616,  1P(a;«0.320,  y(ft^-0.080, 
3P(A,)xi0.320,  and7<Aj)«0.200),  and  from  this  information  it  is  possible  to  assess  the 
impact  that  new  evidence  will  have  on  the  probability  of  any  other  h^thesis.  For 
example,  propagating  the  observation  that  hypothesis  hf,  decreasing  altitude  is 
truo,  will  lead  to  a  number  of  revisions  of  belief.  This  involves  the  re-ordering  the 
cliques  \h„  AJ,  fti,  and  {A„  hp  h)  as  shown  in  Rgure  9,  and  propagating 
the  new  evidence  through  the  re-ordered  network  in  accordance  with  (4)  and  (5). 
.Which,  eventually  leads  to  the  calculation  of  revised  marginal  probabilities,  as 
follows:  3»*CA,)«0.208, 3**(fc;»0.333,  and  !P»(A,)«0.325. 

Current  belief  !P*(Aj)  ■  prior  belief  given  some  evidence  IP(A,|A,)  (4) 

or  y*(A.)  »  y{h,\h.)  •  yihMm  0.064  ■  0.104  from  Table  4  (5) 

JP(A,)  0.616 


Figure  9.  Assessment  of  the  effect  of  a  Decrease  in  Altitude 

Although  the  above  example  may  appear  to  be  overly  simplified,  there  has 
been  at  least  one  highly  publicized  instance  of  an  unidentified  agent  being 
mistakenly  classified  as  hostile  (by  the  USS  Vincennes)  based  on  a  fairly  similar 
scenario  [4].  In  any  event,  the  completeness  of  domain  model  should  not  be  the 
issue,  what  is  important  to  note  is  that  network  representations  can  effectively  be 
emplt^ed  to  manage  the  uncertainty  inherent  in  solving  classification  problems. 


126 


iiiil 


BaRT  has  been  successfully  applied  to  a  number  of  military  problems  [321, 
and  work  aimed  at  applying  BaRT  to  other  military  problems  is  currently  under 
way.  These  efforts  have  been  aided  by  the  fact  that  BaRT  incorporates  a  number 
of  different  knowledge  representation  and  reasoning  schemes,  and  the  ability  of 
BaRT  to  operate  as  a  stand-alone  classification  decision  aid,  or  as  a  cooperative 
component  of  a  larger  knowledge-based  system  [32j.  The  importance  of  tfiese 
characteristics  cannot  be  overstated  (see  [11]  for  further  details),  and  particular 
note  should  bo  made  of  ttie  fact  that  reusable  knowledge-based  system 
components  can  be  developed  and  applied  to  military  problems  till. 

Although  details  are  sketchy,  the  module-oriented  approach  to  problem 
solving  employed  by  BaRT  appears  to  adhere  to  the  development  framework  that 
forms  ttie  basis  for  much  of  the  recent  DARPA  sponsored  research  aimed  at 
developing  next-generation  knowledge-based  systems  [1, 10, 22, 26, 311,  like  the 
Pilot’s  Associate.  A  comprehensive  analysis  of  this  research,  which  encompasses 
the  entire  spectrum  of  military  problems,  would  undoubtedly  assist  any  military 
professional  seeking  to  exploit  the  potential  of  knowledge-based  systems 
technology.  However,  few  technical  details  are  available  (111,  and  much  of  this 
research  is  shrouded  in  secrecy.  For  this  reason  an  analysis  of  BaRT  is 
particularly  useful  to  the  military  professional  seeking  a  better  understanding  of  the 
problems  that  can  affect  the  implementation  of  this  technology  [30]. 

BaRT  is  an  automated  reasoning  tool,  developed  at  the  Naval  Research 
Laboratory  (NRL),  which  employs  a  framework  of  Bayesian  techniques  to  manage 
ttHi  uncertainty  associated  with  generic  classif!cation  problems.  BaRT  can  function 
es  a  stand  alone  decision  aid,  or  it  can  act  as  the  classification  module  of  a  larger 
knowledge-based  system,  and  BaRT  has  been  successfully  applied  to  a  number 
of  military  classification  problems. 


Conclusion 


Knowledge-based  systems  have  evolved  to  the  point  where  they  can 
coherently  represent  large  amounts  of  knowledge  and  efficiently  reason  with 
uncertain  information  [10],  These  same  systems  have  proven  their  worth  in 
industry  [17-20],  and  during  the  Gulf  War  [25,  28],  and  the  implications  of  tfiis 
technology  on  the  military  are  clean  evolution,  or  extinction. 

Although  no  clear  "best*  approach  can  be  identified  for  the  r-janagement  of 
uncertainty  in  knowledge-based  systems,  various  techniques  have  proven  their 
applicability  to  specific  types  of  problems  [8, 11].  Efforts  aimed  at  developing  task- 
specific  systems  have  led  to  the  realization  that  many  problems  can  be 
decomposed  into  task-specific  component  parts  (e.g.,  the  classification  problem 
addressed  by  BaRT),  and  that  knowledge-based  systems  capable  of  solving  these 
gen^  tasks  can  be  used  to  construct  cooperative  systems.  A  number  of  tiiese 
cooperative  knowledge-based  systems  are  being  developed  to  address  complex 
military  problems  [22,  31],  and  development  frameworks  employing  a  module- 
oriented  approach  have  been  developed  to  facilitate  this  process  [27]. 

Next-generation  knowledge-based  systems,  with  multilevel  application 
architectures,  have  demonstrated  that  feasible  solutions  to  complex  problems  can 
be  obtained  [31],  and  further  developments  are  expected  in  the  near  future  [10]. 
The  implementation  of  these  systems  can  result  in  failure  [30],  and  it  is  imperative 
that  organizations  wishing  to  adopt  this  technology  adopt  a  systematic  approach 
that  address  both  technical  and  organizational  concerns. 
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Notes 

1.  The  terms  “knowledge-based  system"  and  “expert  system"  are  not  used  by 
all  authors  In  the  same  context,  and  the  expression  knowledge-based  system 
is  used  througho'jt  this  text,  in  accordance  with  [16],  to  refer  to  any  computer 
system  tha;*  consists  of  a  knowledge  base,  and  a  knowledge  base  manager. 

2.  While  acknowledging  that  efforts  aimed  at  developing  computer  systems 
capable  of  providing  military  commanders  with  intelligent  assistance  can  be 
viewed  from  a  number  of  different  perspectives,  and  that  many  of  these  views 
are  based  on  radically  different  philosophic  and  moral  beliefs,  this  paper  does 
not  address  tiiese  issues.  This  text  is  not  a  philosophic  dissertation,  it 
examines  what  has  been  reported  in  the  open  literature,  and  rio  attempt  has 
been  made  to  resolve  any  of  the  underlying  philosophical  problems  with,  or  the 
moral  objections  to,  the  development  of  intelligent  advisors  for  military  use. 

3.  Alt.hough  a  comprehensive  review  of  the  uncertainty  m'magement  literature 
would  clearly  be  useful,  there  are  a  number  of  practical  problems  which  make 
such  an  undertaking  a  virtual  impossibility  [16].  These  problems  include:  the 
quantity  of  information  [5,  6],  the  diversity  of  uncertainty  management 
approaches  [11],  the  range  of  prac'ical  techniques  that  exist  [15],  and  the 
complexity  of  the  knowledge-based  system  environment  In  addition, 
uncertainty  management  approaches  are  designed  to  deal  with  the 
multidimensional  problem  of  acquiring,  representing,  and  reasoning  with 
knowledge,  and  each  of  these  issues  are  complex  problems  in  their  own  right 
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Abstract 

The  Particle  Accelerator  Contr  jl  Expert  System  (PACES)  Is  an  expert-system-based 
real-time  control  system  for  the  KN-3C00  high  voltage  particie  accelerator.  It  is  designed  to 
be  an  accelerator  operators  companioa  automatically  performing  established  procedures, 
such  as  start-up  and  shut-dowa  fri  order  to  relieve  the  operator  from  the  drudgery  of 
accelerator  control.  Additionally.  H  will  act  as  an  Mcelerator  performance  monitor  with  die 
ability  to  rapidly  detect  operating  faults  or  anomalies,  alert  the  operator,  and  suggest  possible 
solutions.  PACES  is  (banned  also  to  serve  as  an  educational  platform  fOr  the  training  of  new 
accelerator  operators. 

This  paper  is  concerrwl  In  particular  with  the  knowledge  engineering  aspects  of  the 
system.  After  attempting  to  implement  ttie  knowler^e  base  under  two  different  commercial 
shells.  It  was  realized  that  neither  offered  an  ideal  development  environment.  The  chosen 
course  of  action  was  to  develop  a  customized  shell  that  would  provide  both  flexibility  and 
inferencing  speed.  Both  of  these  factors  are  crucial  to  effective  real-time  control  of  ttio 
accelerator. 

Knowledge  engineering  for  PACES  involves  several  important  issues.  Rrst.  there  is 
the  need  to  encapsulate  expert  knowledge  into  the  system  in  a  form  that  facilitates  automatic 
accelerator  operation.  This  is  a  generic  problem  in  expert  system  design  whose  solution 
usually  differs  from  application  to  application.  Second,  it  is  necessary  under  certain 
circumstances  to  partition  the  system  in  such  a  way  foat  time-consuming  inferencing  is 
minimized  in  favour  of  faster,  more  algorithmic  control.  It  is  seen  that  accelerator  control  wiB 
require  fast,  narrow-minded  decision-making  for  raprfd  fine  tuning,  but  slower,  broader 
reasoning  for  machine  start-up,  shut-down,  and  fault  diagnosis  and  correction.  Additionally, 
it  Is  important  to  render  the  knowledge  base  in  a  form  that  is  conducive  to  operator  training; 
the  expert  system  must  be  aware  of  differerrt  levels  of  accelerator  expertise  and  respond 
accordingly. 

A  promising  form  of  PACES  involves  a  hybrid  system  in  which  high-level  reasoning 
is  performed  on  the  host  machine  that  interacts  with  the  user,  while  an  embedded  controller 
employs  neural  networks  for  carrying  out  fast  but  limited  on-the-fly  arflustment  of  accelerator 
performance.  This  partitioning  of  duty  facilitates  a  hierarchical  chain  of  command,  yielding  an 
effective  mixture  of  speed  and  reasoning  abiKty. 

IDept  of  Electrical  md  Computer  Engineering.  *  Dept  of  Cotnp  Sd  and  Systems,  ’McMaster  Accelerator 
Lib,  McMaster  TJniv,  Hamilton,  ^Sdentific  Authority,  Electrooics  Div,  DREO,  Ottawa 
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Introduction 

The  KN  model  3000  particle  accelerator  [5]  situated  at  the  Defence  Research 
Establishment  Ottawa  (DREO)  is  employed  primarily  to  produce  monoenergetic  neutrons 
for  the  calibration  of  radiation  detectors.  Its  daily  use  involves  little  variation  since,  at 
present,  it  is  only  operated  for  this  single  purpose.  Recently,  many  accelerator  operators 
(experts)  have  reached  retirement  age  and  there  is  a  seed  *o  transfer  their  operational 
expertise  to  their  successors.  In  an  effort  to  smooth  this  transition,  and  to  providb  a  solid 
foundation  for  new  operators,  it  was  deemed  productive  to  develop  an  expert  system  for 
toleration  of  the  KN.  Hiis  expert  system  would  not  only  provide  assistance  for  new 
operators,  but  would  also  reduce  the  operator  time  required  for  accelerator  start  up, 
steady-state  control  and  shut-down,  allowing  other  more  valuable  tasks  to  be  performed. 

The  requirements  of  the  overall  control  system  are  summarized  below  (in  no  particular 
order): 

^Robustness:  The  acceleratcn’  is  a  source  of  botli  high-voltage  and 
radiation  levels,  and  the  system  must  be  resistant  to  such  hazards. 

>-Manual  override:  At  any  tinae,  the  human  operator  must  be  able  to  rapidly 
assume  r<miplete,  direct  control  of  the  accelerator. 

>"User~fnendUness:  The  front  end  (user  interface)  of  the  system  must  be  both  easy 
and  desirable  to  use  (so  that  the  user  finds  the  system  helpful  and  beneficial). 

^"Smarts":  Although  the  system  is  presided  over  by  a  human  operator,  it  must 
still  be  able  to  act  autonomously,  niaking  decisions  in  a  fashion  that  mimics  the 
expert  operator  as  closely  as  possible. 

>Speedy  decision  making:  Control  of  the  accelerator  is  a  real-time  control 
problem,  and,  as  such,  the  control  system  is  time-critical. 

>-Faidt  detection,  analysis  and  diagnosis:  A  major  aspect  of  the  control  system’s 
knowledge  base  is  the  instillation  of  the  expert’s  Imowledge  of  how  to  detect 
operating  faults,  analyze  them  and  suggest  and/or  affect  remedial  action. 

^^Repeatability:  The  control  system  should  be  able  to  reproduce  previous  operating 
parameters  in  order  to  repeat  past  particle  beam  behaviour. 

>Flexibility  and  Extendibility:  The  control  system  must  facilitate  easy  upward 
expansion. 

To  these  ends,  the  Applied  Computersystems  Group  [6]  (ACsG)  has  undertaken  to 
develqi  an  expert-system-based  accelerator  control  facility,  primarily  for  use  with  the 
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KN-3000  at  DREO  [71.  This  control  system,  the  Particle  Accelerator  Control  Expert 
System  (PACES),  is  intended  to  augment  operation  by  raising  the  operational  expertise  of 
non-expert  operators.  Ibus,  an  operator  will  be  relieved  of  the  repetitive  aspects  of 
accelerator  control. 

For  a  mote  detailed  presentation  of  the  initial  project  description  and  a  summary  of  early 
development,  please  refer  to  [8]. 

Overview  of  the  Operating  Environment 

The  KN  is  a  Van  de  Graaff  particle  accelerator  that  uses  the  generation  of  static  charge 
to  provide  particle  energies  up  to  4MeV  (mega-electron  volts).  Panel  1  depicts  a 
of  thc  accclcrator  (9],  showing  the  Van  de  Graaff  generator  housed  inside  a  tank 
that  is  electrically  insulated  with  pressurized  sulphur-hexafluoride  (SF*).  A  radio  frequency 
ion  source  (typically  hydrogen  or  deuterium)  is*  used  to  inject  particles  into  the  accelerator. 
The  particles  are  accelerated  from  the  machine  in  a  beam  which  can  be  focused  and  steered 
to  one  or  more  target  areas  where  the  actual  experiments  occur. 

Usual  operation  of  the  accelerator  begins  with  the  machine  in  a  “cold”  state  O-c- 
completely  inactive).  The  operator  carries  out  a  start-up  procedure  (which  may  call  for  the 
re-establishment  of  a  previous  day’s  operating  conditions)  that  culminates  in  the  generation 
of  a  stable  particle  beam  that  is  operated  in  a  steady-state  mode  (or  perhaps  pulsed  mode) 
for  a  length  of  time  (typically  several  hours),  after  which  the  machine  is  shut  down  to  its 
“cold”  state  once  again.  Aside  from  daily  variations  in  operating  conditions,  start-up  is 
essentially  the  same  process  each  time,  whereas  the  shut-down  procedure  seldom  varies. 
Steady-state  operation,  however,  depends  largely  on  the  nature  of  the  day’s  experiments  as 
well  as  the  dynamic  behaviour  of  the  machine  itself  (eg.  changes  in  behaviour  due  to 
heating,  age  and  condition  of  components).  It  may  be  necessary  during  this  steady-state 
period  to  perfonn  small  parameter  changes,  such  as  altering  particle  energy,  beam  current 
or  ion  species.  The  steady-state  operation  is  further  characterized  by  the  possible 
occurrence  of  operating  anomalies,  faults  and/or  failures. 

Panels  2  and  3  show  a  stylized  image  of  the  accelerator’s  control  panel.  This  control 
panel  presents  three  main  types  of  instramentation:  meten,  selsyns  and  switches.  The 
meters  register  the  various  qwrating  parameters  of  the  accelerator  (e.g.  vacuum  pressure, 
beam  current,  terminal  voltage).  The  selsyns  are  pairs  of  electrically  coupled  dynamos,  one 
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on  die  control  panel  and  tme  inside  the  accelerator  tank,  that  enable  the  operator  to 
manually  adjust  a  physically  isolated  mechanism  (e.g.  a  iheostat  or  valve)  via  an  electrical 
feedback  link.  The  switches  turn  on  or  off,  for  example,  the  control  power  and  the  drive 
motor  of  the  Van  de  Graaff  generator,  and  select  the  type  of  gas  for  the  ion  source. 

During  ntmoial  qieration,  the  operator  watches  the  meters  to  observe  the  behaviour  of 
the  accelerator  and  adjusts  some  or  all  of  the  four  selsyns  to  alter  this  behaviour  to  a  mote 
suitable  state.  Thus,  from  a  process  control  perspective,  the  meters  are  inputs  to  die 
controller,  while  the  selsyns  (and  switches)  are  outputs  of  the  controller. 

Control  System 

PACES  is  a  complex,  distributed  control  program  that  runs  on  two  or  more  computers 

•  *  * 

(Figure  1).  The  host  computer,  typically  an  AT-style  386  or  486  computer  with  high 
resolution  SVGA  or  XVGA  graphics  capability,  runs  the  front  end  user  interface  and 
expert  system.  The  host  computer  is  connected  through  an  RS-232  serial  line  to  a  single 
board  computer  [10]  (SBC)  embedded  controller.  This  SBC  is  connected  to  the  accelerator 
through  special  electronics  circuitry,  and  is  responsible  fc^  direct  accelerator  control  and 
data  acquisition.  The  host  computer  acquires  accelerator  operating  parameters  from  the 
SBC  and  uses  them  to  make  control 
decisions  which  result  in  control 
commands  being  sent  to  the  SBC.  The 
combination  of  host  computer,  SBC  and 
control  circuitry  constitute  the  control 
system’s  closed  feedback  loop. 

The  host  computer  may  also  be 
connected  to  one  or  more  remote  consoles, 

^ically  AT-stylc  386  or  486  computers. 

The  remote  consoles  are  connected  to  the 
host  via  RS-232  serial  links,  and  may  use 
high  speed  (9600  baud)  modems  to 
establish  links  ova*  telephone  lines.  The 
remote  consoles  act  as  functional 
extensions  of  the  host  computer’s  user  interface,  enabling  the  accelerator  operator  to 
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Figure  1.  PACES  components. 


monitor  and  control  the  machine  from  locations  other  than  the  main  contrrl  room.  This  is 
useful  during  experiments,  when  the  experimenters  spend  most  of  their  time  In  the  target 
area,  but  still  wish  to  have  control  over  the  accelerator  without  having  to  travel  to  the 
OMitrol  room.  Additionally,  the  use  of  a  modem  over  telephone  lines  enables  a  person  at 
another  locadon,  perhaps  many  miles  away,  to  access  and  operate  the  accelerator  for  expert 
diagnosis  or  troubleshooting  purposes. 

The  control  system  can  be  roughly  divided  into  five  sections  (Figure  The  system 
manager  is  the  top  level  of  the  program  that  oversees  and  coordinates  the  other  sections. 
The  user  interface  is  the  control  system’s  link  with  the  operator.  The  control  interface  is 
responsible  for  uploading  telemetric  data  from  the  SBC  and  sending  it  control  commands. 
Hnally,  the  irferetae  engine  and  knowledge  base  are  used  for  making  heuristic  decisions.  • 

PACES  runs  under  Mterosott 
Windows  3.0  [11].  It  is  written  in 
Tuibo  Pascal  for  Windows  [12] 

(TPW),  which  offers  an  casy-tt>-use 
object-oriented  platform  f<v  rt^id, 
ttraightforward  developn^nt  of 
Wbidows  applications. 

User  Interface 

The  Windows  graphical  user  Figure  2.  System  hierarchy, 

interface  (GUI)  is  employed  to 

present  the  accelerator  <^>erator  with  a  functional  facsimile  of  the  accelerator’s  control 
panel  (Panels  2  and  3).  Effort  has  been  taken  to  preserve  as  much  of  the  real  control 
panel’s  appearance  and  behaviour  as  possible.  This  control  panel  enables  the  ojjerator  to 
control  the  machine  through  the  computer  by  reading  analog  meters  and  using  the 
ctnnputer’s  mouse  and  keyboard  to  perform  control  actions.  The  operator  can  also  initiate 
ffytfwnatii^  Start-Up  or  shut-down  procedures,  browse  and  repeat  past  accelerator  runs,  and 
log  accelerator  data  to  disk. 

Graphical  meters  display  real  time  accelerator  operating  parameters  such  as  terminal 
voltage  and  beam  current  It  was  found  during  preliminary  field  tests  that  accelerator 
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operators,  being  used  to  reading  real  analog  meters,  preferred  them  to  strictly  digital 
displays.  The  PACES  meten  provide  both  analog  Md  digital  displays,  so  that  the  operator 
sees  die  usual  analog  display  as  well  as  a  quantitative  value.  Additionally,  each  of  the 
meters  has  a  “stripcharT  grtqih  (sec  Panel  3)  that  can  be  opened  to  display  the  meter’s 
value  and  rate  of  change  as  functions  of  time. 

The  primary  controls  for  the  accelerator  are  the  four  selsyns  (shown  as  dark  circles  on 
die  control  panel  in  Figure  2).  These  selsyns  may  be  operated  manually  or  set  on 
automatic;  in  automatic  mode,  the  control  system  uses  algorithmic  and  heuristic  techniques 
to  alter  the  selsyn  settings  in  order  to  maintain  particle  beam  stability. 

There  are  also  various  buttons  and  switches,  some  that  diiecdy  control  the  accelerator 

•  •  • 

(e.g.  power  on/off,  drive  motor  on/off),  and  others  invoking  sub-systems  of  the  program 
(such  as  the  start-up  procedure). 

Expert  System 

Requirements 

Four  key  areas  of  accelerator  control  rely  on  classical  knowledge-based  inferencing: 

►  Start-up:  The  expert  system  is  used  to  start  die  accelerator  and  produce  a  stable 
particle  beam  with  specified  physical  characteristics. 

►  Shut-down:  The  accelerator  is  shut-down  in  an  expedient  manner.  As  described 
in  the  section  on  Fault  Detection  and  Diagnosis,  the  expert  system  may  be  called 
upon  to  pei'foi'm  normal  shut-down,  rapid  safing  0n  order  to  recover  from  a 
possibly  dangerous  anomaly),  ot  panic  shut-down  (in  event  of  a  catastrophic 
fault). 

>■  Steady-state:  The  particle  beam  must  be  maintained  within  the  specified 
operating  limits.  The  expert  system  is  used  to  maximire  beam  stability  while 
afftnding  the  operator  s<»ne  capability  to  alter  the  accelerator’s  behaviour  as 
required. 

►  Fault  Detection  and  Diagnosis:  The  knowledge  base  and  expert  system  are  used 
to  detect  and  diagnose  faults  in  the  accelerator.  Detection  involves  expert 
heuristics  to  determine  from  the  accelerator  operating  parameters  what  type  of 
fault  <x  aberration  is  occurring.  Diagnosis  involves  selection  of  the  best  means  of 
overcoming  the  problem,  be  it  a  simple  control  adjustment,  immediate 
shut-down  or  request  for  operator  intervention. 
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TTie  “expert  system”  component  of  PACES  is,  consequently,  lequiied  to  posses  several 
important  characteristics: 

►  It  must  be  embedded  in  the  control  program  as  a  whole,  and  not  a  stand-alone 
ti^  level  shell.  Due  to  the  real  time  nature  of  the  control  system,  it  is  necessaty 
to  relegate  the  “expert  system”  to  a  subservient  level;  the  expert  system  is 
invoked  by  the  system  manager  when  needed,  but  never  assumes  complete 
control.  The  expert  system  is  periodically  called  u^  to  detect  operating  faults 
or  awfwwlifts  and  to  perform  heuristic  decision  making. 

>■  It  must  provide  both  forward  and  backward  chaining.  Forward  chaining  is  uKd 
during  steady-state  beam  maintenance,  while  backward  chaining  is  used  during 
fitult  dctectionAccovery  and  when  the  <^»erator  desires  to  alter  beam 
characteristics. 

*  ►  The  expert  system  must  be  amenable  to  “stop  and  starf*  infcrcncing.  The  real 

time  nature  of  the  control  problem  requires  that  the  inference  engine  be  able  to 
suspend  its  current  reasoning  path  in  order  to  follow  some  other  reasoning  path 
as  events  warrant 

Early  Attempts 

Two  early  attempts  at  integrating  an  “off  the  shelf”  expert  system  shell  with  PACES  met 
widi  disappointing  results.  The  Personal  Consultant  Plus  (PC+)  [13]  expert  system  shell  was 
considered  first  but  was  found  to  be  quite  unamenable  to  being  embedded  in  a  larger 
application  [8].  Its  snail-like  inferencing  speed,  high  demand  on  system  resources  and 
cmi^Iicated  exomal  language  interface  mechanism  made  it  unwieldy  as  an  “on  line”  real 
riiTift  embeds  inference  engine.  Kappa-PC  [14]  was  also  briefly  evaluated  since  it  offen 
many  features  that  PC+  lacks.  Kappa-PC  is  designed  as  a  Microsoft  Windows-based  extensible 
expert  system  shell.  Although  Kafpa-PC  was,  in  many  ways,  ufeal  for  the  requirements  at 
hand  [g],  it  is,  at  present  only  extensible  using  Microsoft  C,  which  was  found  to  possess  a 
somewhat  hostile  user  interface  aversive  to  rsqjid  software  prototyping.  A  desirable  form  of 
Kappa-PC  would  be  that  of  a  Windows-format  dynamic  link  library  (DLL)  that  could  easily 
be  integrated  into  the  control  system  regardless  of  the  programming  language  used  for 
develt^ment 

&  was  finally  dfcid«vi  diat  die  best  jqiproach  was  to  use  a  custom-made  expert  system 
shell  that  would  be  designed  from  die  outset  to  possess  die  tfcsired  qualities.  The  next 
section  briefly  describes  this  shell,  the  Windows  Application  eXpert  system  (WAX)  shell. 
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Expert  System  Design 

The  WAX  shell  is  written  as  a  collection  of  objects  in  a  TPW  unit  (separately  compiled 
module).  Rgure  3  shows  how  WAX  is  integrated  into  the  application  as  a  whole.  The  WAX 
unit  does  not  contain  any  “knowledge”,  but  only  the  mechanisms  for  manipulating 
Onfeiencing)  knowledge.  The  “knowledge  bases”  are  stored  ia  separate  TPW  units,  and 
dynamically  linked  to  the  inference  engine  at  runtime.  These  knowledge  base  units,  which 
achieve  the  useful  software  engineering  property  of  it^ormeaion  hiding,  contain  ndts  and 
irformation  objects  (object-oriented  data  structures).  In  developing  knowledge  objects,  the 
knowledge  engineer  (progranuner)  is  free  to  use  as  much  of  TPW’s  extensible 
tAject-tmented  capability  as  desired.  The  knowledge  base  rules  are  written  by  the 
knowledge  engineer  to  process  the  information  objects  in  order  to  derive  new  information 
objects  or  cause  side  effects  in  the  implication.  (Two  examples  of  side  effects  are  a  pop-up 
message  {uompt  that  asks  die  user  to  input  a  piece  of  information,  and  assertion  of  a  control 
action  that  causes  actuation  of  an  external  device.) 

The  principal  object  in  the  WAX  unit  is  the 
infrnence  engine  that  is  used  to  evaluate  rules.. 

Rules  are  passed  to  the  inference  engine  in 
prioritized  rule  sets  that  represent  domains  of 
knowledge.  The  inference  engine  is  re-entrant 
so  that  it  can  be  interrupted  while  inferencing 
one  rule  set  in  mder  to  inference  a  different 
rule  set  Rules  are  able  to  change  the  course  of 
inferencing  by  calling  WAX  subroutines  that 
start  suspend  or  stop  inferencing  chains,  or 

alter  die  membership  of  rale  sets.  Figure  3.  The  WAX  shell. 

Typically,  the  top  level  of  the  smpfreation  initiates  inferencing  in  response  to  a  request 
from  the  user,  or  after  some  external  condition  has  occurred  (such  as  a  timed  event  or 
intmupt).  The  application  dynamically  creates  an  inference  engine  object  and  passes  it  a 
rule  set  thereby  starting  die  inferencing  mechanism.  The  inference  engine  then  proceeds  to 
evaluate  the  rales  in  its  rale  set  until  the  rale  set  is  empty  or  the  engine  is  suspended  or 
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stqjped.  Infertncing  proceeds  under  the  Windows  multitasking  environment  so  that  the 
infsrendng  can  be  performed  “in  parallcr  witii  other  operations  (15]. 

The  WAX  implementation  results  in  a  flexible  inferencing  system  that  places  a  large 
burden  on  the  knowledge  engineer  with  regard  to  implementing  the  knowledge  base.  In 
certain  situations,  this  approach  is  unsuitable  since  it  requires  that  the  knowledge  engineer 
be  a  proficient  programmer.  Nevertheless.  WAX  is  intended  primarily  as  an  embeddable 
iftferenciiig  system,  and  thus,  is  inherently  tied  with  software  development  and 
prograituning.  WAX  is  not  meant  to  replace  conventional  shells  that  offer  ease  <rf 
knowledge  encapsulation  without  requiring  a  high  tevel  of  programming  ability  on  the  part 
erf  die  knowledge  engineer,  bstead,  WAX  is  designed  to  sacrifice  gerranc  ease  of  use  and 
high  shell  overhead  in  favour  of  ^'extreme  amount  of  low  level  flexibility  and  minimal 
shell  overhead. 

Knowledge  Engineering  for  PACES 

The  problem  <rf  controlling  dte  accelerator  presents  a  myriad  conaplications,  ranging 
fiom  teal  time  control  considerations  and  controller  robustness  to  educational  and  safety 
The  PACES  knowledge  base  should  cnc^sulate  as  much  expert  knowledge  as 
possible,  especially  in  the  area  of  fault  detection  and  diagnosis,  while  still  preserving  a  high 
degrw  of  real  time  response. 

Knowledge  engineering  for  PACES  was  performed  in  conventional  manner.  Various 
expert  accelerator  qperattws  were  interviewed  and  observed  over  several  sessions,  notes 
were  by  hand  and  the  interviews  were  ts^Jcd  using  an  audio  cassette  recorder. 
Fbllowing  preliminary  interviews,  a  prototype  knowledge  base  was  constructed  dtat 
inqjlemoated  the  start-up  and  shut-down  procedures.  A  development  cycle  ensued  in  which 
testing  was  followed  by  expert  evaluation  and  knowledge  base  modification  and  further 
testing.  At  present,  the  knowledge  base  is  still  in  this  development  phase. 

Algoritiimic  Control  vs.  Heuristic  Decision  Making 

The  control  system  as  a  whole  is  partitioned  into  several  layers.  The  SBC  is  the  lowest 
level,  possessing  little  or  no  heuristic  knowledge,  but  a  large  amount  of  algorithnuc 
procedures  [16];  die  SBC  responds  to  control  and  data  acquisition  commands,  but  has  no 
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volition  of  its  own.  At  the  top  level,  the  host  PC  strikes  a  balance  between  complete 
heuristic  activity  and  algorithmic  activity.  Algorithms  are  used  for  well  defined  control 
procedures  in  order  to  increase  efficiency  and  response  time,  whereas  heuristics 
(inferencing)  are  used  for  expert-like  decision  making.  Certain  aspects  of  the  accelerator 
control  problem  are  nxne  vuted  to  being  implemented  as  algorithms.  Shut-down,  for 
example,  almost  always  follows  dte  same,  step-by-step  procedure.  Steady  state  beam 
maintenance,  however,  calls  for  a  mix  of  heuristics  and  algorithms;  control  decisions  are 
made  using  inferencing.  but  execution  of  the  control  decisions  (e.g.  feedback  loops) 
lequiies  algorithmic  processing.  Hie  WAX  shell  provides  a  simple  means  of  melding 
imicedural  activity  with  heuristic  reasoning:  Since  WAX  rules  ue  merely  external 
procedures,  they  are  .  unconstrained  as  to  die  scope  and  depth  of  their  effects  on  the 
qiplication  as  a  whole.  Rules,  for  example,  may  initiate  a  completely  algorithmic  feedback 
control  kxq>,  succeeding  only  when  the  control  loop  meets  some  convergence  criterion. 

An  Eiamplf 

An  exan^le  of  this  aigorithixi/heuristic  blend  is  presented  in  Panel  4,  which  illustrates 
part  of  an  actual  accelerator  run  in  which  the  control  system’s  start-up  process  was 
performed.  The  goal  of  this  part  o£  the  stait-up  procedure  is  to  reach  a  specified  tsiminai 
vdtage  (enugy  potential  (sx  accelerating  the  particle  beam).  The  teraiinal  voltage  is 
determined  by  the  amount  of  electrostatic  charge  deposited  from  a  moving  belt  onto  the 
Van  de  Graaff  generamr’s  terminal,  as  determinc  l  by  the  belt  chaige  selsyn:  Increasing  the 
belt  duuge  increases  the  terminal  voltage.  V^ious  focton,  such  as  spark  damage  to  the 
terminal  and  die  current  of  the  particle  beam,  alter  the  relationship  between  belt  cha2ge 
and  lenninal  voltage,  so  die  relationship  is  non-linear  and  subject  to  deviations. 

As  the  expert  S3rsrem  works  its  way  through  the  start-up  procedure,  the  stage  is  reached 
where  the  belt  charge  selsyn  must  be  turned  up  until  die  required  torminal  voltage  is 
exceeded  slighdy  [17].  Althou^  this  could  be  implemented  as  a  purely  deterministic 
feedback  loqi,  PACES  instead  encoiporates  inferencing  into  the  control  loop  in  an  e^ort  to 
d^ect  any  problems  diat  might  arise  during  start-up.  This  is  analogous  to  operators  who 
follow  a  general,  well-established  start-up  procedure  while  simultaneously  using  their 
expertise  to  watdi  for  unexpected  problems  (such  as  terminal  voltage  slew  rate,  poOT 
vacuum,  or  improper  5?^  pressure).  Hence,  the  algorithmic  nature  of  the  start-up  procedure 
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is  augmented  by  diagnostic  heuristics  to  produce  a  smart,  flexible  and  robust  automated 
stan>up  process. 


Panel  4  captures  this  start-up  process  as  smoothed  real-time  accelerator  data  logged 
ftom  the  McMaster  KN-3000.  The  graph  plots  the  belt  charge  selsyn  (thin  line)  and 
termini  voltage  (thick  line)  as  functions  of  time.  It  is  important  to  note  that  the  value 
shown  for  die  selsyn  is  the  set  point  that  the  host  commanded  the  selsyn  to  turn  to;  the 
actual  selsyn  setting  may  require  several  seconds  to  reach  this  set  point 

Tte  control  power  b  switched  on  at  time  0,  which  produces  a  sharp  rise  in  the  terminal 
voltage  to  its  uncharged  baseline  value  (approximately  250  kV).  The  start-up  process  then 
proceeds  to  verify  several  safety  interlocks  (e.g.  cooling  water  turned  on,  tank  SF,  pressure 
within  acceptable  limits).  Next  the  Van  de  Graaff  drive  motor  is  switched  on,  followed  by 
the  power  supply  for  the  belt  charge.  At  approximately  18  s,  the  expert  system  begins 
turning  up  the  belt  charge  selsyn.  A  fact  stored  in  the  knowledge  base  indicates  that  there  is 
a  “dead  zone”  in  the  selsyn,  and  the  first  1 1  full  turns  of  the  selsyn  will  have  no  effect  on 
die  terminal  voltage.  The  expert  system  therefore  quickly  turns  the  selsyn  dirough  11  turns 
(requiring  roughly  15  seconds). 

The  feedback  control  loop  is  entered  at  35  s,  at  which  tinM  the  controller  gpws  the 
selsyn  a  slight  increase,  and  waits  until  the  rate  of  change  of  the  terminal  voltage  reaches 
zero  (indicating  that  the  charging  voltage  has  “caught  up”  with  the  control  action).  The  belt 
charge  increase  continues  in  this  stcp-like  manner  until  the  terminal  voltage  exceeds  the 
specified  value  by  no  more  than  10  kV.  This  goal  is  reached  approximately  80  s  after  the 
start-up  procedure  was  conuncnced.  Once  the  specified  terminal  volta^  is  reached,  the 
start-up  procedure  goes  on  to  extract  ions  from  the  accelerator’s  ion  &Kircc  and  focus  these 
particles  into  a  beam.  The  entire  start-up  process  reaches  its  goal  when  the  particle  beam 
striking  the  first  Faraday  cup  possesses  the  specified  energy  and  current 

Fault  Detection  and  Diagnosis 

The  most  impentant  duty  of  the  PACES  expert  system  is  the  timely  detection  of  faults 
followed  by  expedient  remedial  action.  This  fault  detection  and  diagnosis  relics  on 
heuristic  inferencing  because  there  is  a  distinct  lack  of  sensors  that  could  be  used  to  directly 
detect  the  many  types  and  locations  of  faults;  rather  than  easily,  repeatedly  polling 


hundreds  of  sensors,  the  control  system  must  rely  on  inferring  anomalous  behaviour  from 
the  available  telemetric  data  (derived  from  the  control  panel’s  meters).  This  is  just  the  way 
that  skilled  operators  diagnose  problems:  they  are  drawn  to  abnminal  readings  on  dte 
control  panel  meters,  reason  about  causes  and  dien  try  to  rectify  the  problem. 

PACES  is  able  to  classify  faults  into  a  continuum  of  severity  (Figure  4).  Low  severity 
faults  cause  minor  problems  (such  as  slight  beam  instability)  that  can  be  ignored  by  the 
ccmtrol  system  unless  they  become  more  severe.  During  such  low  seve^'ty  conditions,  the 
expert  system  will  limit  operation  of  the  accelerator  in  certain  ways,  such  as  imposing  an 
upper  bound  on  the  permissible  terminal  voltage  and/or  beam  current.  (For  example,  poor 
vaccum  would  “de-rate’*  the  maximum  terminal  voltage  to  1  MV  rather  than  the  normal 
3  MV  until  the  viu;oum  improves.  This  problem  can  arise  after  the  accelerator  has  been 
opened  to  air  for  maintenance,  and  requires  several  hours  after  re-sealing  to  achieve 
(^timal  vacuum;  during  this  time  the  machine  is  still  operable,  but  not  at  maximum  rating. 
Thus,  dte  expert  system  is  capable  of  “conditioning”  the  accelenttor  in  a  manner  analogous 
to  a  seasoned  operator’s  use  of  the  machine  under  similar  circumstances.) 

High  severity  faults  may  require  the  control  system  to  initiate  safing  (cut  off  of  particle 
beam)  or  complete  shut-down,  or  may  cause  a  hardwired  safety  interiock  to  trip.  In  the 
latter  case,  dte  control  system  must  recognize  the  trip  and,  if  appropriate,  attempt  recovery. 

The  fault  continuum  is  donainated  by  a  wide  range  of  severity  that  represents  faults  that 
are  too  severe  to  ignore  but  not  severe  enough  to  trigger  a  shut-down.  It  is  for  this  wide 
variety  of  cases  diat  the  expert  system  is  utilized  to  analyze  the  anomalous  symptoms  and 
produce  a  diagnosis.  Due  to  the 
large  number  of  possible  faults, 
and  the  low  number  of  indicates, 
the  expert  system  is  charged  with 
finding  the  most  plausible 
explanation  for  die  anomaly.  As 
an  exanqile  of  this  diagnosis, 
consider  the  problem  of  “no  Hnire4.Se>rerityoffault8. 

beam”  (Bgure  5):  The  start-up  procedure  has  progressed  to  the  point  at  which,  under 
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normal  circumstances,  a  beam  current  should  be  measured  at  the  tint  Faraday  cup 
(Panel  1)  [18]. 

The  particles  that  form  the  accelerator’s  beam  are  the  charged  ions  of  a  gas  plasmx  The 
gas  is  stored  in  a  pressurized  bottle  [19].  Gas  is  let  out  of  die  bottle  through  a 
thermomschanical  leak  controlled  by  the  gas  selsyn:  Turning  up  the  gas  selsyn  heats  up  the 
thermomechanical  leak,  increasing  die  gas  leakage  rate.  The  gas  flows  into  the 
near>vacuum  ionizing  chamber  where  a  radio  fiequency  (RF)  oscillator  ionizes  the  gas 
atoms.  The  extraction  selsyn  is  used  to  control  a  negative  voltage  at  the  qien  end  of  the 
ionizing  chamber  which  causes  die  positively 
charged  ions  to  flow  out  of  the  chamber  into 
the  accelerating  column. 

Given  the  above  description,  the  “no 

beam"  problem  occurs  when  there  is  no 

measurable  beam  current  on  the  Faraday  cup 

even  diough  the  terminal  voltage  is  correct 

and  the  gas  and  extraction  selsyns  have  been 

.  , .  .  ■  Figure  5.  “No  beam”  diagnosis, 

adjusted  properly.  The  lack  of  beam  is  most 

likely  caused  by  either  failure  of  the  RF  source  (due,  perhaps  to  a  failed  electronic 
conqionent  such  as  a  vacuum  tube),  or  a  lack  of  gas  to  be  ionized.  To  begin  the  diagnosis, 
the  expert  system  consults  the  knowledge  base  to  determine  when  the  gas  bottle  was  last 
changed.  If  the  gas  bottle  has  not  been  changed  for  some  specified  time,  the  expert  system 
can  suggest  that  the  botde  needs  to  be  re-filled.  If  the  gas  botUe  was  recently  changed,  the 
lack  of  beam  is  probably  not  caused  by  an  empty  botde  [20].  Given  that  the  bottle  is  not 
empty,  the  expert  system  can  hypothesize  that  the  problem  probably  lies  in  the 
diermomechanical  leak  nwchanism.  This  hypothesis  can  be  automatically  tested:  The  gas 
selsyn  is  zeroed,  the  gas  source  is  switched  to  the  other  gas  botde,  and  the  gas  selsyn  is 
turned  back  up.  If  this  test  succeeds  in  producing  a  particle  beam,  the  expert  system  can 
that  the  original  gas  botde’s  leak  mechanism  is  faulty.  If  the  test  fails,  the  expert 
system  can  infer  that  there  is  an  electrical  problem  shared  by  both  thermoirochanical  leaks 
(e.g.  their  power  supply). 
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Although  overly  simplided,  the  **no  beam”  example  illu^ztes  the  extent  to  which 
PACES  uses  knowledge-based  inferencing  to  diagnose  accelerator  faults  and  resolve 
conflicting  symptoms.  In  many  situations,  the  expert  system  can  be  engineered  to  perform 
explorative  troubleshooting  (such  as  switching  gas  bottles)  to  reduce  its  search  space  during 
fault  diagnosis.  In  some  cases,  the  expert  system  is  able  to  overcome  the  problem  and 
continue  accelerator  operation;  other  problems  result  in  shut-down  and  the  posting  of  a 
diagnostic  message  that  the  operator  can  use  to  affect  repain. 

Neural  Network  Controller 

An  interesting  facet  of  the  PACES  control  system  is  the  implementation  of  neural 
networks  on  the  SBC  [21].  Data  logged  fiom  many  accelerator  runs  can  be  organized  into 
training  sets  to  train  a  neural  network  to  recognize  the  characteristics  of  a  stable  particle 
beam.  The  PACES  knowledge  base  can  then  include  a  repertoire  of  neural  network 
“programs”  (weight  sets  and  neural  topographies),  and  the  expert  system  can  then  select  a 
template  to  configure  the  SBC  to  perform  rapid  line  tuning  of  a  certain  type  of  particle 
beam.  In  titis  scenario,  the  neural  network  assumes  control  of  the  accelerator  until  the 
operator  chooses  tc  alter  the  beam  or  the  beam’s  stability  deviates  beyond  preset  limits. 
When  such  alteration  or  deviation  occurs,  the  SBC  notifies  the  host  computer  and  the 
expert  system  assumes  control.  After  the  beam  is  re-stabilized,  the  SBC  may  be 
te-configuied  with  a  new  template,  and  resumes  control. 

Concluding  Remarks 

Tlte  Particle  Accelerator  Control  Expert  System  is  now  beginning  its  diird  3tear  of 
developnoent  The  first  year  saw  the  formulation  of  the  control  problem,  the  construction  of 
the  control  circuitry  and  the  evaluation  of  various  expert  system  shells  and  programming 
environments.  The  second  year  centered  around  implementation  of  the  user  interface  and 
knowledge  engineering  for  the  start-up  and  shut-down  procedures.  It  is  planned  that  the 
third  year  will  concern  broadening  of  the  knowledge  base  to  encapsulate  a  greater 
capability  for  fault  detection  and  diagnosis,  as  well  as  the  addition  of  the  neural  network 
controller.  It  is  also  hoped  that  the  research  project  will  be  extended  to  cover  control  of  the 
acceleratOT’s  beam  line. 

PACES  is  promising  to  be  a  useful  tool  for  both  expert  and  novice  operators.  Its 
automation  of  the  repetitive  aspects  of  accelerator  operation  relieves  the  operator  of  some 
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of  the  drudgery  of  accelerator  control.  The  expert  system’s  diagnostic  facility,  when 
completed,  will  serve  to  bridge  the  expertise  gap  between  seasoned  eperators  and  new 
trainees,  b  this  regard,  the  MS-OOS/Windows  environment  is  a  user-tunable  GUI  that  can  be 
tailcned  to  different  levels  of  expertise  and  to  different  penonal  tastes.  Such  interfaces  are 
extremely  valuable  in  enticing  non-computer  operators  to  embrace  this  new  technology  for 
machine  control  Moreover,  the  dedicated  and  consistent  approach  to  fault  detection  is 
believed  to  improve  safety  considerations  122)  since  the  computer,  unlike  the  human 
operator  if  busy  at  another  task,  does  not  need  time  to  “plug  in”  to  the  current  opc^ting 
environment  to  make  a  key  decision  on  shut-down. 
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15.  Windows  performs  non-preempdve  round  robin  task  switching. 

16.  As  described  in  the  Neural  Network  Cona^oUer  section,  the  SBC  is  “programmed”  by 
the  expert  system  to  perform  limited  scale  flne  tuning  using  a  neural  netwotic. 
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Panel  4.  Terminal  voltage  goal  of  start-up  procedure. 
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THE  HYPERMEDIA  TECHNOLOGY  AS  A  FRONT  END  TO  KNOWLEDGE 

PROCESSING  SYSTEMS 

P.R.  Roberge' 

Abstract 

Technological  Improvements  can  empower  people,  enabling  them  to 
accomplish  tasks  that  once  seemed  impossible.  Potent  computer-based 
technologies  are  increasingly  reshaping  our  expectations  and  hopefully  serving 
human  needs.  At  present  the  CP  is  facing  a  number  of  challenges  such  as 
mastering  increasingly  complex  technology  and  systems  •  while  facing  also 
increasingly  severe  shortages  of  recruits  with  above-average  intelligence  and 
static  or  shrinking  budgets.  The  increased  requirements  for  complex  expertise  in 
the  CF  has  to  be  addressed  by  means  Independent  of  the  constant  drain  of 
corporate  memory  and  know-how  Imposed  by  posting  and  transfers.These 
challenges  can  be  partly  addressed  by  the  development  of  artificial  intelligence  (Al) 
tools  which  would  supp^  some  critical  phases  of  the  decision-making  processes. 

Tvwo  types  of  Al  tools  have  recently  gained  the  general  confidence  of  both 
developers  and  users  of  these  technologies  and  reached  die  main  stream  of 
computer  goods.  But  these  two  technologies,  database  management  systems 
(DBMSs)  and  expert  systems  (ESs),  have  had  little  interaction  with  each  other.  It 
is  clear,  however,  that  future  decision-support  systems  will  require  both  the 
problem-solving  capabilities  of  ESs  and  the  data-handling  capabilities  of 
DBMSsJhis  paper  ^  describe  bowtifae JiypertexLoiLhypemiedia  technology  is 
capable  of  integrating  different  knowledge  processing  technologies  such  as  DBMSs 
and  ESs  while  creating  very  flexible  user  interfaces  for  decision-support  systems. 


'Associate  Phrfessor,  Dept  of  Oieimstiy  &  CStemical  Gb^neering.  RMC,  Kingston 
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INTRODUCTION 

Some  of  the  most  famous  expert  systems  (ESs)  have  not  gone  beyond  the 
development  stage  because  they  could  not  be  timely  integrated  in  the  workplace,  they  could 
not  communicate  smoothly  with  users. 

A  major  strength  of  ESs  is  that  within  a  narrow  domain  they  are  able  to  capture 
much  of  the  procedural  expertise  that  a  human  expert  uses  to  make  decisions.  Although 
ESs  often  fail  to  perform  at  the  same  level  of  competence  as  human  experts,  they  can 
effectively  serve  as  intelligent  advisers  for  new-experts  freshly  posted  to  a  new  engineering 
position.  An  ES  can  thus  guide  a  novice  in  making  decisions  which  are  consistent  with 
those  that  a  human  expert  would  make. 

Weaknesses  of  ESs  include  their  inability  to  capture  some  of  the  important 
nuances  of  expert  decision  making  [IJ.  ESs  may  typically  offer  accurate  advises  for 
general  or  routine  problems,  but  are  quite  inefficient  to  meet  unusual  or  exceptional  cases. 
Even  when  the  recommended  course  of  action  is  adequate,  the  steps  taken  by  ESs  to  arrive 
at  a  conclusion  are  not  the  same  ones  that  a  human  expert  would  use.  This  makes  it 
difficult  for  such  systems  to  explain  their  behavior  in  a  way  that  is  useful  to  human  users 
[2]. 

One  of  the  main  challenges  faced  by  designers  of  such  systems  is  the  development 
of  high  grade  user  interfaces.  Wide  acceptance  and  use  of  any  computer  program 
presuppose  a  good  interface  and  the  task  is  not  necessarily  easy.  It  is  common  knowledge 
amidst  workers  in  the  field[31  that  designing  a  good  interface  can  consume  up  to  one  half 
of  a  project's  development  time.  A  few  general  observations  have  been  made[4]  on  which 
to  base  design  requirements  for  user  interfaces: 

•  No  single  interface  can  satisfy  all  categories  of  users,  nor  can  it  meet  all  the  needs  of  a 
single  user  over  time 

•  Any  interface  should  be  amenable  to  custom-tailoring  by  the  end  user 

•  Interfaces  should  be  easy  to  understand  and  designed  to  avoid  information  overload 

•  An  interface  should  be  transparent  and  never  leave  the  user  in  the  daik 

The  hypertext  technology  is  ideally  suited  to  accomplish  these  demanding  goals 
and  facilitate  the  design  of  intuitive  user  interfaces  for  decision-support  systems.  While 
ESs  are  designed  to  solve  specific  problems,  hypertext  systems  are  built  to  convey 
information.  TTiesc  two  objectives  are  flip  sides  of  the  same  coin.  Some  of  the 
inefficiencies  of  ESs  can  be  overcome  by  integrating  the  features  of  hypertext  and  some  of 
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the  weaknesses  in  hypertext  systems  can  be  overcome  by  using  ESs  This  complementarity 
will  be  illustrated  witli  examples  from  systems  recendy  developed  to  either  die  prototype 
level  or  simply  as  proof  of  concept  for  teaching  or  training  applications.  But  first  a  brit  J 
introduction  of  both  the  hypertext  and  ES  technologies  will  be  presented  as  a  preamble  to 
the  choice  of  tools  made  for  these  projects. 

TOOLS 


Hypertext  Systems 

While  the  term  hypertext  was  coined  by  Ted  Nelson  during  the  1960s(51.  the 
concept  itself  can  be  traced  back  to  Vannevar  Bush's  1945  description  of  the  mcmex[61. 
Tlie  first  serious  attempt  to  build  a  memex  did  not  take  place  until  20  years  after  Bush  s 
description.  In  1968,  Doug  Engclbart,  then  at  the  Augmented  Human  Intellect  Research 
Center  (Stanford  Research  Institute),  conducted  a  diamatic  live  demonstration  of  his 
Augment  system  during  the  Fall  Joint  Computer  Conference  where  he  worked 
collaboratively  on  a  hypertext  document  with  a  colleague  500  miles  away!?]. 

In  the  following  years  both  interest  and  activity  in  hypertext  have  grown  steadily.  ■ 
Some  of  the  more  important  milestones  have  been  described  in  the  introductory  paper  of  a 
special  issue  of  Communications  of  the  ACM[81  which  was  devoted  to  hypertext  as  a  form 
of  electronic  documentation  or  information  management  An  excellent  survey  of  existing 
hypertext  systems  wiUi  a  critical  review  of  their  strengths  and  weaknesses  was  published  in 
1987[91.  In  this  article  the  operational  advantages  of  hypertext  were  described  to  be  die 
following: 

•  ease  of  tracing  references 

•  ease  of  creating  new  references 

•  hierarchical  or  non-hierarchical  information  structuring 

•  global  and  local  views  can  be  mixed  effectively 

o  multiple  functions  customized  documents 

•  modularity  and  consistency  of  information 

•  task  staking 

There  arc  many  ways  in  which  associative  linking  or  non-linear  writing  and 
reading  can  be  used.  Today,  you  can  find  hypertext  links  in  on-line  help  systems  in  a  great 
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variety  of  systems  such  as  Microsoft  Windows™,  personal  information  managers,  text 
retrieval  systems,  ESs  and  application  generators.  But  the  programs  that  use  hypertext 
fully  are  authoring  software  systems  that  are  designed  to  create  electronic  manuals,  training 
courses  and  other  large  text  based  applications.  The  two  products  that  were  selected  in  the 
present  project  to  create  an  hypertext  interface  to  some  expertise  management  systems  had 
been  recently  reviewed  in  a  popular  PC  computer  magazine[10]. 

The  first  system  (HyperWriter™  from  Ntergaid)  was  this  magazine  Editor's 
choice.  It  was  said  to  have  nearly  every  type  of  link  available,  from  various  kinds  of  text 
links  to  graphics,  video  and  digitized  sound.  This  system  was  also  described  to  be 
extremely  attractive  for  its  support  of  runtime  versions,  both  for  their  price  (free)  and  their 
navigational  tools  such  as  the  ability  to  call  a  graphics  map  of  links  in  the  document,  see  a 
reading  history,  tag  files  and  leave  bookmarks. 

The  second  system  (Guide™  by  OWL  International)  was  said  to  come  close  to  the 
first  in  its  functional  richness!  lOJ.  This  Windows™  ^plication  was  believed  to  have 
superior  formatting  capabilities  and  a  very  good  control  over  graphics.  It  also  had  the 
advantage  of  being  nested  in  Windows  which  meant  easy  navigation  between  this  software 
and  other  available  Windows  graphics  and  datalK.ses  software. 

ExpsilSygKins 

There  has  been,  in  the  past  two  decades,  a  virtual  explosion  of  interest  in  the  field 
of  ES  development  ESs  has  quickly  evolved  from  an  academic  notion  into  a  proven  and 
highly  marketable  product  one  that  offers  an  efficient  and  effective  approach  to  the 
solution  of  real-world  problems.  By  the  end  of  the  I98()s  the  implementation  of  at  least 
2000  ESs  had  already  been  documented  within  the  corporate  world  alone[  1 1]. 

ESs  differ  from  conventional  programming  in  the  sense  that  it  is  a  genuine 
approach  to  decision  making  or  to  a  methodology  in  the  support  of  decision  making.  In 
order  to  become  an  expert  in  rule-base  development  it  is  necessary  to  fully  understand  the 
multiple  elements  associated  with  such  development: 

•  Knowledge  acquisition 

•  Knowledge  processing  and  inference 

•  Validation  of  the  knowledge  base 

•  Implementation  and  maintenance 

Two  commercial  ES  shells  or  tools  were  examined  for  their  incorporation  in 
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information  processing  systems.  These  have  been  described  as  middle  range  software 
packages!  12]. 


The  translation  of  technical  know-how  and  common  sense  into  programmed 
heuristics  can  be  made  by  using  such  a  commercial  shell  that  synthesizes  many  years  of 
research  and  development  The  PC+™  development  tool  uses  the  same  knowledge 
representation  scheme  which  was  used  for  the  MYCIN  and  later  the  EMYCIN  projects  at 
Stanford  University!  13].  The  primary  knowledge  representation  scheme  in  PC-i-  is 
production  (if/then)  rules  which  describe  an  inference  that  can  be  made  about  a  certain 
situation.  This  rule  architecture  has  some  advantages!  14]: 

•  Humans  can  relate  to  production  rules  as  "rules  of  thumb" 

•  Rules  are  very  modular  and  therefore  easy  to  modify 

•  Rule  specification  is  non-procedural  and  can  be  arranged  by  the  system  itself 

•  Rules  allow  for  explanation  of  reasoning 

The  PC+  development  environment  contains  all  the  features  necessary  to  create 
and  test  knowledge-bases  (simple  rule  entry  language,  editor,  listing  facility  anu  debug 
aids).  PC+  is  written  in  LISP  which  makes  it  relatively  slow  to  operate.  One  characteristic 
of  this  shell  is  its  tigid  user  interface  which  depends  entirely  on  pop-up  menus. 


Nexpert  Object  1.1^  is  an  innovative  ES  shell  that  combines  rules  and  objects 
very  efficiently.  Nexpert  is  written  in  C  and  fully  utilizes  the  facilities  offered  by  running 
in  the  screen  oriented  Microsoft  Windows™  environment  One  of  the  key  features  of  this 
system  is  a  common  rule  format  for  forward  and  backward  chaining.  Using  such  a 
common  format  for  both  types  of  reasoning  signifies  that  the  knowledge-base  can  be  used 
in  multiple  ways  to  derive  a  maximum  of  information  from  a  given  set  of  instructions. 
Nexpert  Object  runtime  platform  interrogates  the  user  by  means  of  custom-made  forms 
displayed  on  the  screen  which  supports  pop-up  and  horizontal  bar  menus.  But  a  serious 
disadvantage  of  this  system  is  the  high  price  one  has  to  pay  for  these  run-dme  platforms. 

EXAMPLES 

Four  recent  projects  will  be  briefly  described  to  demonstrate  how  the  hypertext 
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technology  was  used  as  a  front-end  to  knowledge  base  systems.  The  first  two  systems  were 
developed  to  the  prototype  level  in  order  to  serve  as  demonstrators  or  proof  of  concepts. 
The  intended  users  were  to  be  newly  posted  personnel  requiring  specialized  training  as  well 
as  practicing  engineers  and  scientists  requiring  some  degree  of  expert  support  The  second 
pair  of  systems  presented  as  examples  are  only  in  their  early  design  stage.  The  intention,  at 
the  moment  is  to  introduced  these  systems  as  lecture  material  or  used  them  as  course 
support  in  some  of  RMC  undergraduate  courses  on  Chemical  and  Materials  Engineering. 


The  first  example  presented  is  a  software  prototype  which  was  developed  for  the 
Director  Avionics,  Simulators  and  Photography  (DASP)  during  the  accomplishment  of  a 
Task[15]  aimed  at  defining  an  approach  for  the  development  of  a  flexible  knowledge-base 
system  for  the  management  of  chemical  power  source  systems.  The  first  prototype  itself 
was  entirely  programmed  in  PC+  in  a  multi-tier  structure.  At  each  search  level  the  user 
was  given  the  opportunity  to  select  one  of  the  choices  displayed  on  the  screen.  This 
selection  was  made  by  using  cursor  arrows  to  highlight  a  choice  and  <CR>  to  enter  the 
choice  itself.  Rg.  I  iUustrates  a  typical  consultation  screen  of  this  first  prototype. 

The  prototype  developed  with  PC+  was  found  to  be  too  rigid,  insufficiently  user- 
friendly  and  monotonous.  While  the  integration  of  graphics  in  the  system  was  theoretically 
possible,  its  effects  were  found  to  be  quite  unpredictable  and  degraded  extensively  the 
operational  reliability  of  the  system  itself.  Such  a  drawback  was  considered  to  be  serious 
since  a  fair  portion  of  the  information  required  to  build  the  prototype  referred  to  battery 
design  features  which  arc  better  represented  by  drawings.  The  PC+  cooperation  with 
commeaial  database  systems  was  not  veiy  satisfactory  since  it  could  not  override  the 
production  of  the  series  of  title  screens  produced  each  time  the  systems  were  called 
forward. 

The  attempt  to  transfer  the  knowledge-base,  developed  during  the  first  part  of  this 
project,  to  a  different  ES  programming  environment  (Nexpert  Object)  also  turned  out  to  be 
disappointing  even  if  the  system  tested  was  said  to  be  graphic  oriented  and  user  friendly. 
Unlike  PC+,  Nexpert  Object  lets  the  developer  control  the  user  interface  but,  even  then,  its 
form-creating  facilities  were  found  to  be  inadequate  for  the  task  and  the  user  interface 
remained  relatively  monotonous(Fig.  2).  Although  it  was  possible  to  incorporate  graphics 
in  die  development  version  this  remained  impossible  for  the  runtime  versions  themselves. 
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WHAT  TYPE  OF  INFORMATION  ARE  YOU  SEEKING? 


m 


AmCRAFT 


ENVIRONMENT 

INFORMATION  ON  BATTERIES 

MILITARY  SPECIFICATIONS 

PERFORMANCE 

COUPLES 

BATTERIES  NATO 

MORE  INFORMATION  ABOUT  CAFCEBA 
DO  NOT  KNOW 


L  U$e  cursor  arroivs  or  type  fust  letter  to  select  an  item. 
2.  Confirm  by  depressing  ENTER. 


Fig.  I  Typical  consultation  screen  of  the  PC+  chemical  power  sources  knowledgc- 


Fig.  2  Typical  consultation  screen  of  the  Nexpert  Object  chemical  power  sources 
knowledge-base  prototype. 

The  latest  prototype  was  built  in  the  hypertext  environment  (HyperWriter)  as  an 
interlinked  network  of  nodes  (Fig.  3)  The  system  contains  various  types  of  battery 


base  prototype. 


Select  the  type  of  airplane  the  batteiy  is  going  to  be  used  in: 


CF-I14T  CF-5  CF-18  CT-133  CC-130  CC-144  CC-137 


Ttahsceiver 


Select  the  ^tem  the  batteiy  is  going  to  be  used  in: 

Radar  Computer  Emergency  Locator  Transceiver 


I  pc  ENTER  >  to  pre^eed} 
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information  as  texts  or  graphics  and  can  be  triggered  to  access  database  files  (Paradox  3.5™ 

by  Borland)  by  means  of  C  coded  routines  or  fire  the  ES  which  had  been  developed  in 
Ncxpert 

The  hypertext  environment  was  also  successfully  tested  during  this  project  for  its 
ability  to  incorporate  external  graphic  files.  Several  pictures  were  scanned  and  added  to 
the  system  with  overall  links  or  by  a  screen  sensitization  method  (Tiot  spots'). 


Rg.  3  General  structure  of  the  hypertext  battery  information  system  with  links  to 
databases  and  an  ES  prototype  for  the  selection  of  batteries. 

Eailure.  Analyst 

The  second  prototype  presented  as  an  example  of  a  hypermedia  front  end  to  ESs 
was  developed  during  the  completion  of  a  Master  thesis  in  Chemical  and  Materials 
Engineering[16].  The  general  goal  of  Failure  Analyst  was  to  support  personnel  involved 
with  material  'roblems  where  Stress  Corrosion  Cracking  (SCC)  is  either  suspected  or  a 
potential  cause  of  failures. 

The  architecture  of  Failure  Analyst  followed  the  recommendations  outlined  by 
Turban(17].  The  top  goal  or  objective,  which  was  here  jo  determine  the  extent  to  which 
SCC  can  be  considered  to  be  a  serious  problem,  was  first  established  by  prioritizing  all 
contributing  factors  to  failure.  An  inference  tree  (Fig.  4)  helped  to  organize  these  factors  in 
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an  orderly  and  comprehensive  manner.  This  inference  tree  also  served  as  the  backbone 
structure  to  construct  the  various  programs  that  can  be  activated  during  a  single 
consultation.  Several  test  cases  were  selected  to  test  the  effectiveness  of  Failure  Analyst  to 
come  to  plausible  conclusions  and  the  results  of  these  tests  were  compared  to  answers 
provided  by  human  experts  in  an  effort  to  validate  the  computerized  approach. 


Fig.  4  Inference  tree  of  SCC  factors  considered  by  Failure  Analyst 

While  the  early  knowledge  organization  of  Failure  Analyst  was  conceived  around 
the  PC+  platform,  its  construction  was  directly  made  in  the  hypertext  environment 
(HyperWriter).  The  prototype  fully  used  the  non-linear  information  processing  capabilities 
of  the  hypertext  environment  by  constructing  queries  as  series  of  cards  or  windows 
interlinked  in  a  very  structured  fashion.  With  such  an  organization  a  continuous  control 
was  kept  over  the  user  progress  through  the  maze  of  possible  questions  and  interconnected 
non-sequential  links.  When  programming  in  a  hypertext  environment  it  is  important  to 
achieve  a  balance  between  the  depth  of  information  sought  and  ease  of  navigation  without 
getting  lost  in  hyperspace. 

Failure  Analyst  was  constructed  by  assigning  help  or  explanation  windows  to 
each  question  with  tlie  possibility  of  always  looping  back  to  the  initial  question  of  a  scries. 
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Such  a  loop  prevented  the  user  to  avoid  answering  important  questions  while  providing 
timely  infonnation.  Over  300  links  and  100  windows  were  assembled  in  the  prototype  user 
interface.  The  data  transfer  to  nested  programs  (written  in  QuickBASIC  by  Microsoft)  was 
achieved  with  scripted  commands.  The  interactive  links  permitted  by  these  commands 
became  an  essential  component  of  the  organization  of  the  whole  system  itself.  Fig.  5 
describes  the  overall  architecture  of  Failure  Analyst 


Failure 

Analyst 


IntrodfvetiM 


Hc«l  Trmtaiciitft 


SlrtM  Ltvd 


Alloy  Type 
Processing 
Crack  Path 
Grain  Size 
Microstructure 
Form 
Thickness 
Stress  Direction 
Residual  Stress 
Corrosion 
Chemical  Analysis 
Surface  Treatment 


Fig.  5  General  structure  of  Failure  Analyst  with  links  to  important  components  of 
the  knowledge  base. 


Putting  a  barrier  between  a  corrosive  environment  and  the  material  to  be  protected 
is  a  fundamental  method  of  corrosion  control.  It  is,  in  fact,  the  most  widely  used  method 
of  protecting  steel  and  other  metals.  The  concept  of  adding  coatings  to  surfaces  is  so 
ancient  that  its  beginnings  are  lost  in  the  mists  of  history.  Mechanisms  by  which  coatings 
protect  can  be  summarized  as  follows(l£]: 

•  They  prevent  contact  between  the  environment  and  the  substrate 

•  They  restrict  or  limit  contact  between  the  environment  and  the  substrate  as  with  most 
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organic  coatings 

•  They  release  substances  which  arc  protective  or  which  inhibit  attack 

•  They  produce  a  protective  electric  current 

A  common  reason  why  protective  coatings  do  not  perform  well  is  often  because 
they  have  not  been  considered  as  systems.  Most  successful  coating  engineers  approach  a 
coatings  project  in  much  the  same  way  that  t^ey  approach  any  other  engineering  problem, 
beginning  with  the  design  of  surfaces  to  be  protected  and  ending  with  schedules  for 
monitoring  the  completed  wotk. 

A  global  representation  of  the  features  which  would  be  included  in  this  hypertutorial  is 
presented  in  Fig.  6.  The  generic  information  on  coatings  which  will  be  used  for  this 
prototype  already  exist  in  a  textbook  form  [19].  The  system  will  make  full  use  of  the 
programming  easiness  provided  for  this  kind  of  projects  by  the  Windows  environment 
Tables  will  be  constructed  using  the  kxcel  database  system  which  communicate  to  the 
hypertext  environment  (Guide)  through  transparent  Dynamic  Data  Exchange  (DDE)  links. 
The  coatings  tutorial  will  also  be  linked  to  a  fully  operative  commercial  ES  specialized  in 
the  selection  of  coatings  (Coating  Counsel  by  Counselware  Inc.  [20]).  Coating  Counsel  is 
designed  to  select  optimal  coating  systems  for  industrial  maintenance  applications.  It  can 
write  complete  Construction  Specification  Institute  format  specifications  in  a  matter  of 
minutes. 


Information  Processing  for  Materials  Performance 


This  system  under  consideration  would  help  newly  posted  engineers  to  learn  the 
complexity  of  maintaining  systems  integrity.  Such  a  task  has  become  increasingly  more 
complex  since  modem  plants  are  also  increasingly  automated,  larger  and  more  expensive  to 
own  and  operate.  The  high  costs  of  maintenance  resources  and  equipment  availability  have 
thus  become  a  critical  factor  in  companies  profitability.  The  parallel  growth  in 
sophistication  and  technological  content  of  maintenance  work  has  made  its  management  far 
more  difficult[21].  In  order  to  improve  maintenance  management  and  scheduling,  it  is 
imperative  to  consider  introducing  in  normal  operations  some  of  the  modem  tools  that  have 
been  developed  for  accurate  surveillance  and  monitoring  of  critical  systems. 

In  recent  years  a  tremendous  progress  has  been  made  for  the  understanding  of 
effects  caused  by  various  types  of  material  damage.  Very  complex  mechanisms  are 
gradually  being  defined  for  stress  corrosion  cracking,  hydrogen  attack,  hot  corrosion  and 
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other  forms  of  deterioration.  For  practical  structural  integrity  applications  proper  decisions 
about  the  type  of  inspection  and  its  frequency  have  to  be  made. 


Ftg.  6  General  structure  of  the  coating  hyper-instructor  with  links  to  knowledge 
components  and  to  a  fully  operative  commercial  coating  selector  ES 
(Coating  Counsel). 

Several  inspection  types  can  be  used  and  the  choice  of  a  specific  scenario  will 
depend  on  the  accuracy  and  cost  of  the  inspection.  The  accuracy  of  a  given  technique  must 
be  sufficient  to  detect  defects  considerably  smaller  than  those  which  could  result  in  failure. 
A  cheaper  and  less  accurate  technique  used  frequently  could  be  equivalent  costwise  to  a 
more  expensive  and  more  accurate  technique  used  less  frequendy  leading,  however,  to 
greater  reliability.  Regardless  of  the  technique  that  has  been  chosen,  the  critical  decision 
remains  with  the  frequency  of  application.  This  decision  depends  on  three  things[22]: 

•  the  extent  of  damage  that  might  remain  invisible  to  the  technique 

•  the  rate  of  damage  occurrence  with  dme 

•  the  extent  of  damage  the  structure  can  tolerate 

The  applicability  of  a  given  inspection  technique  to  a  particular  problem  will 
heavily  depend  on  the  nature  of  the  problem  itself.  The  internal  inspection  of  a  pipe  system 


could,  for  example,  be  attempted  by  using  a  crawler  device  which  would  carry  an  optical 
probe  and  corrosion  sensors[23].  But  such  a  practice  can  only  be  performed  during  shut¬ 
downs.  The  inspection  of  in-service  systems  is  also  often  complicated  by  the  fact  that  these 
systems  operate  at  relatively  high  temperatun;  in  a  closed  mode.  While  traditional 
techniques  are  effective  in  detecting  and  sizing  existing  defects  there  are  a  number  of 
disadvantages  associated  with  their  use[24]: 

•  traditional  inspection  technique  can  only  be  used  on  high  temperature  process 
equipment  when  the  equipment  is  out  of  service. 

•  inspection  is  generally  limited  to  suspected  problem  areas  due  to  time,  accessibility  and 
cost  factors. 

•  the  fundamental  lack  of  knowledge  on  the  effect  of  exposure  of  given  materials  to 
specific  environments. 

Computers  are  ideally  suited  to  keep  track  of  all  the  different  deterioration  rates 
for  thousand  of  pieces  of  plant  equipment  But  it  is  important  that  the  inspection  files  be 
arranged  or  organized  for  an  efficient  management  analysis.  A  few  systems  are  being 
commercialized  to  provide  these  services.  MAPS™[25],  for  example,  includes  programs 
for  information  management  integrated  with  other  software  systems  that  handle  erosion  • 
corrosion  surveys,  plant  inspections,  OSHA  compliance  surveys  and  other  specialized  tools 
that  can  handle  Computer  Assisted  Design  (CAD)  data  bases  or  simply  run  problem¬ 
solving  routines.  Another  example  of  maintenance  enhancement  through  integrated 
software  is  the  MASC^[26]  Inspection  Program  which  claims  to  be  able  to  assist 
inspection  engineers  in  the  management  of  effective  inspection,  predictive  maintenance, 
reliability  engineering  and  corrosion  control  programs.  Table  1  lists  some  operations 
provided  by  such  an  integrated  inspection  tool. 

The  present  goal  for  this  project  is  to  create  a  platform  with  would  help  to  clarify 
which  sectors  of  this  vast  domain  could  be  feasible  targets  for  very  focused  ES  given  the 
expertise  available.  The  Windows  environment  seems  presently  the  environment  of  choice 
to  develop  an  open  ended  architecture  for  a  preliminary  prototype.  The  easy  access  to 
information  processing  software  in  this  environment  will  make  the  creation  of  a  modular 
structure  interestingly  possible.  In  its  preliminary  version  the  system  will  be  used  to  teach 
the  fundamentals  of  corrosion  monitoring  showing  particularly  how  the  information 
gathered  during  off-line  and  on-line  inspections  can  be  translated  into  plant  integrity 
information  understandable  by  management  personnel 


14 


Table  1  Typical  modules  of  a  complete  integrated  system  for  inspection  and 
maintenance  planning. 


Ins 

pection 

Communication 

Data 

Records 

•  general  information 

•  engineering 
information 

•  operational  conditions 

•  materials 

•  observations 

•  recommendations 

•  measurements 

•  corrosion  rate 

•  retirement  thickness 

•  life  to  retirement 

•  inspection  interval 

•  next  inspection 

•  due  date 

•  memos 

•  work  requests 

•  maintenance  inquiries 

•  operational  inquiries 

•  engineering  inquiries 

•  materials  inquiries 

•  inspection  approvals 

•  shutdown  reports 

•  budget  preparation 

CONCLUSION 

The  weaknesses  found  in  traditional  ES  shells  for  the  construction  of  user-friendly 
and  stand-alone  ESs  can  be  greatly  overcome  by  creating  high  grade  user  interfaces  with 
commercial  hypertext  or  hypermedia  systems.  The  increased  flexibility  gained  by  using 
this  combination  of  tools  can  be  felt  during  the  initial  design  of  such  systems.  The 
examples  presented  in  this  paper  illustrate  how  it  is  possible  to  consolidate  some  area  of 
expertise  by  using  an  open  ended  architecture  to  organize  an  ES  development  strategy. 
Complex  systems  can  be  designed  efficiently  and  simple  prototypes  rapidly  developed  to 
illustrate  the  global  approach  of  a  knowledge  processing  project  The  goal  of  stabilizing  an 
area  of  expertise  can  be  demonstrated  and  implemented  while  keeping  users  interested  in 
systems  under  development 
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APPLICATIONS  OF  EXPERTS  SYSTEMS  IN  DND 
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A  PROBLEM-SOLVING  APPRO  ACH  TO  KNOWLEDGE  ACQUISITION 
Capt  J.G.  Oumats'  and  Dr  A.L  Jenkins' 

'  /  !tttract 

Current  approaches  to  knowtedge  ^quisition  (KA)  are  prknarily  prototyping 
and  modelling.  Many  expert  system  (ES)  projects  developed  under  both 
approaches  never  result  to  a  working  system,  because  of  defciencies  to  the  ES 
develofwnent  process.  This  p^ser  defines  a  KA  methodology  which  should  solve 
some  of  these  problems  and  consequently  make  ESs  more  affordable.  A  phased 
development  process  is  proposed.  The  methodology  us(»  the  charactenstics  of 
the  task  to  determine  first  die  problem-solving  (PS)  motto!  which  best  resembles 
die  strategy  used  by  the  exp^  to  solving  problems.  Furthermore,  this  PS  model 
suggests  the  relevant  knowledge  types  as  well  as  the  general  structure  to  which 
they  must  be  represented  to  be  useful  in  ^tvtog  problems.  Based  on  this 
information,  the  methodology  suggests  appropriate  techniques  to  furdier  assist  die 
knowledge  engineer  to  die  iterative  elicitation  of  the  relevant  knowledge  types. 
Finally,  the  elicited  knowledge  is  validated. 


'Gractuatt  Stttdent.  ^Professor,  of  Eognecnog  Managonent,  KMC,  KiogsiaB 
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»«jer  X  LXTcsjiTuiue  kevdbw 

tWMmocxi(m 

Th«  fact  that  BS  projacta  hava  baan  ovarahooting  tima  and  coat 
aatimataa  at  an  alarain^  rata  la  not  naw  (1)*  Although  projact  managainant 

practlcaa  ara,  in  part,  raaponaibla  for  thia  aituation,  davalopara  ag;  aa 

that  tha  difflcultiaa  inharant  in  llA  play  a  8»ra  ajignif leant  rola  2n 

short,  XA  ia  tha  mowt  critical  of  the  BS  davalopiaant  procaaa  whara 

knowladga  froa  a  variaty  of  aoitrcaa,  and  aora  apacifically  human  axpai^a, 

ia  alicitad,  analysad  and  rapraaantad  explicitly  in  a  format  which 
aubaaquantly  allowa  it  to  ba  coded  for  computer  use.  Thia  paper  ia  an 
attaapt  to  define  a  KA  aathodology  which  ahould  solve  aoaa  of  tha  problems 
aaaoriated  with  thia  procaaa  and  conaaguantly  make  BS  development  acre 
affordable*  This  paper  ia  divided  into  two  parts.  Part  X  gives  a  brief 
review  of  tha  literature  on  the  atibject  of  KA  aathodologiaa,  and  Part  XX 
praaanta,  baaed  on  thia  review,  tha  proposed  KA  methodology. 

wmmMoa  wcQoismom  xrimv 

thm  terms  knowledge  engineering  (K£|,  KA  and  knowledge  elicitation  are 
used  somewhat  loosely  in  tha  literature.  Since  a  clear  definition  of  these 
terms  is  fundamental  to  thia  paper,  they  are  defined  at  thia  time.  KB  ia 
that  branch  of  the  software  industry  concerned  with  the  building  of  BSa  (1]. 
KB  ia  concerned  with  all  aspects  of  ay  stem  devalopoiant,  including  analysis, 
design,  implementation,  and  maintenance.  KA  ia  the  process  of  eliciting, 
analyzing,  and  representing  the  knowledge  used  by  human  experts  ta  solve 
problems  in  a  domain  (3].  KA  is  tha  moat  critical  part  of  tha  KB  process 
and  occurs  mostly  during  the  analysis  phase  of  tha  development.  The 
definition  of  the  term  "methodology"  ia  also  important  hers.  A  methodology, 
in  a  software  development  context,  is  a  systematic  and  planned  approach  for 
completing  one  or  more  of  the  phases  of  the  development  process  (4]. 
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Sine*  KA  is  sn  intsgrsl  part  of  KE,  a  short  discussion  of  KE 
approachss  is  prsssntsd  to  placo  both  in  the  proper  context.  Researchers 
penerallv  distinguish  between  two  RE  epproaches  |5),  prototyping  end 
■odelling,  ee  shown  in  Rig.  1.  Prototyping  owes  its  popularity  among 
knowledge  engineers  to  the  difficulties  esoociated  with  KA.  In  prototyping, 
e  sieplified  eersion  of  the  ES  is  produced  early  in  the  development  process 
end  used  es  e  focusing  device  for  further  RA  cycles.  This  prototype  evolves 
And  in  auiny  caaa*  bncoiwin  t.h#  final  ay  item. 


ThA  Mcond  KE  approach  iri«i#a  th«  ES  develo|»nent  process  as  a  modal  ling 
activity  (61.  Modelling  methodologies  assume  the  existence  of  a  limited  set 
of  repetitive  problem-solving  (ES)  methodSp  which  can  be  modelled  and  re¬ 
used  across  dotuains*  The  XA  process  under  this  approach  consists  of 
analysing  the  expert's  taskp  identifying  a  suitable  PS  method  for  this  tasks 
and  using  the  structure  provided  by  this  PS  method  to  structure  and  guide 
the  top-down  refinement  of  the  knowledge  base  (K8)« 

nOMLEDGE  ACgOISZTIOH  KSTSODOLOGISS 

Two  KA  methodologies  are  described  in  more  detail  in  the  following 
paragraphs  to  better  illustrate  the  KE  approach  they  support. 
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h  Frototypia^  KA  MtliodoXogp 


Om  of  th#  first  sttssipts  st  doexuMinting  s  prototyping  KA  msthodology 
is  prssontsd  by  Orovor  (7}*  Ths  sMthodoIogy  includss  thrM  phssss:  domain 
dsfinition*  fundsaisntsl  knowlsdgs  formulstion^  and  basal  knowladga 
consolidation*  In  tha  initial  dooiain  dafinition^  tha  knowladga  anginaar 
davalops  an  undarstanding  for  tha  axpart's  languaga#  datarwinas  tha  Ifrval 
of  parformanca  of  tha  proposad  systasi#  and  ganaratas  scanarios  or  casa 
problasw  %#hich  ara  asad  to  alieit  tha  axpart's  task  knowladga.  In 
fimdaaantal  knowladga  fonralation  tha  knowladga  anginaar  procaads  with  tha 
alicitation  of  task  knowladga^  i.a.  tha  alicitation  of  procadural  knowladga 
frosi  tha  axpart  using  tha  casa  problams  praviously  idantifiad  in  domain 
dafinition.  In  tha  third  ^asa,  tha  systaa's  reasoning  strategy  and  its 
control  knowladga  ara  isiprovad  iteratively  using  tha  prototype.  Tha 


prototyping  process  is  shown  in  Fig*  2* 


Figure  2.  Tha  KA  process  under  tha  prototyping  approach* 


s 


Prototyping  Lm  usually  dono  using  an  ES  shall  (ESS).  Tha  salaction 
of  this  shall  is  dona  aarly  in  tha  davalopment  procass  and  basad  on  tha 
ganaral  natura  of  tha  axpart  task.  A  shall  assantlally  providas  an 
laplasiantation  formalism,  such  as  rulas,  and  a  dafault  saarch  stratagy  such 
as  backward  chaining.  Tha  main  advantaga  of  using  a  shall  is  that  tha 
prototypa  davalopment  tina  is  graatly  raducad. 

A  Modalliag  KA  Methodology 

(6]  or  Knowladga  Acquisition  Documentation  and  Structuring  Is  an 
Buropaan-fundad  project  developed  through  academic  and  eoemiarclal 
cooperation.  Tha  development  phases  under  EADS  are  analysis,  design, 
l«ples»ntation,  tasting,  and  maintenance.  EADS,  unlike  prototyping, 
eaphasisas  a  clear  distinction  between  tha  analysis,  design,  and 
iag>laawntation  phaaes  of  its  development  process.  At  the  heart  of  EADS  lies 
the  Interpretation  modal  (IM),  which  is  a  model  for  a  PS  method  for  a  class 
of  tasks.  The  four  layers  of  knowladga  used  in  EADS  and  how  these  layers 
are  related  to  the  components  of  interpretation  ana  conceptual  models  are 
shown  in  Pig.  3.  The  four  layers  together  constitute  a  conceptual  model, 
whereas  removing  the  domain  layer,  which  contains  all  domain  knowledge, 
yields  an  ZX.  So  far,  IKs  are  available  for  classification,  heuristic  and 
systematic  diagnosis,  suitability  assessment,  monitoring,  prediction, 
modification,  design,  and  planning  (6J.  It  is  these  IMs  that  allow  for  the 
top**down  r«fin«!»nt  of  tho  M. 

The  analysis  phase  of  EADS  is  divided  into  three  cycles:  orientation, 
problem  identification  and  problem  analysis.  During  orientation,  the 
knowledge  engineer  acquires  the  expert's  vocabulary  and  analyzes  the  task 
to  select -or  construct  an  IM.  Problem  identification  Involves  determining 
the  conceptual  structnre  of  the  domain  and  a  thorough  functional  analysis 
of  the  task.  Finally,  problem  analysis  deals  with  users  and  operational 
issues  which  impact  on  the  architecture  of  the  prospective  ES.  The  outputs 
of  the  analysis  phase,  which  Include  at  least  a  conceptual  model  and  any 
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CMTXQUB  OF  ns  HETBOOOLOOIES 

Based  on  the  KA  methodologiet  described  above,  a  critique  of  both 
prototyping  and  modelling  is  now  presented*  The  main  advantages  usually 
associated  with  a  prototyping  methodology  ere: 

1)  provides  for  speedy  results  which  csn  be  used  to  sell  the 
project  to  an  organisation  (8), 

2)  puts  a  functioning  system  into  the  hands  of  users  quickly  t9]» 
and 

3)  encourages  the  active  participation  of  domain  experts  and 
potential  users  (9), 

However,  these  advantages  are  offset  by  a  number  of  disadvantages 
which  can  be  summed  up  bys  prototyping  encourages  dangerous  shortcuts 
through  the  development  life  cycle  of  a  system  (4J.  More  specifically, 
these  disadvantages  aret 

X)  encourages  a  return  to  the  code,  implement  and  repair  life 
cycle,  or  poor  software  engineering  practices  [lOJ, 

2)  leads  to  premature  commitment  to  an  implementation  formalism 
which  My  be  ill-suited  for  the  dmain  and  the  task  (10], 

3)  leads  to  the  uucontrolled  growth  of  the  KB  usually  associated 
with  a  potential  loss  of  structure  (10], 

4)  encourages  organizations  to  accept  the  prototype  as  the  final 
system  although,  in  most  cases,  it  is  not  appropriate  (llj,  and 

6)  does  not  address  several  design  issues  including:  integration, 
documentation,  reliability,  maintainability,  and  security  (12). 

These  disadvantages  are  further  compounded  in  practice  by  the  use  of 
ESSs,  which  only  offer  a  limited  combination  of  implementation  formalisms 
and  inference  strategies  (6).  The  modelling  methodologies  have,  to  some 
extent,  attempted  to  address  prototyping's  main  disadvantages.  The 
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Advantages  usually  associated  with  modelling  aret 

1)  delays  the  eosnitment  to  an  Implementation  formal ism^  therefore 
allowing  the  analysis  to  proceed  without  having  to  deal  with 
design  and  implementation  issues  [6], 

7)  encourages  good  software  engineering  practices  (6), 

3)  facilitates  the  management  of  the  development  process  by 
providing  a  phased  approach  with  milestones  for  sign-offs  [6J, 

4)  facilitates  the  KA  process  by  allowing  it  to  be  model  driven 
{6],  and 

5)  guides  KA  by  identifying  the  knowledge  types  relevant  to  the 
task  at  hand  (13]* 

Based  on  these  advantages «  it  appears  that  modelling  is  the  more 
promising  direction  in  %ihich  to  proceed  with  KA.  However#  modelling  is  not 
without  problems,  which  remain  to  be  addressed  to  make  this  approach 
workable  in  practice.  The  problems  to  be  addressed  are  1}  the  techniques 
provided  to  the  knowledge  engineer  to  conduct  task  analysis  are  limited,  2) 
the  mapping  between  the  result  of  the  task  analysis  and  a  taxonomy  c^  PS 
models  is  only  possible  for  a  limited  number  of  tasks,  3)  the  suggestion  of 
appropriate  elicitation  techniques  to  acquire  the  relevant  knowledge  types, 
and  4)  the  better  utilisation  of  the  expert  in  the  overall  KA  process.  The 
KA  methodology  proposed  in  this  paper  attempts  to  address  these  problems. 

PAKT  II  A  PKOBLEM-SOLVZNO  APPR0AC8  TO  KA 

Part  Z1  presents  the  development  of  the  proposed  KA  methodology. 
Although  the  development  of  this  methodology  is  central  to  this  paper,  a  KA 
methodology  cannot  be  developed  in  isolation  from  the  K£  approach  it 
supports.  Moreover,  the  concept  of  an  expert  system  development  life  cycle 
(ESDLC)  also  supersedes  that  of  a  KE  approach.  Consequently,  the  first 
section  of  Part  II  addresses  the  ESDLC,  and  presents  a  discussion  of  the 
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fundaMntal  assumptions  on  which  ths  KA  msthodology  is  bsssd*  Ths  sscond 
ssction  covers  ths  most  important  stages  in  the  analysis,  where  the  bulk  of 
KA  takes  place* 

ns  nPEKT  STSTEN  DZVELOFKEHT  LIPS  CYCLE  <BSOLC) 

A  Fluised  Development  Process 

A  phased  approach  characterises  the  development  of  most  commercial 
products,  so  why  should  ESs  be  the  exception?  The  definition  for  KS  reveals 
that,  for  the  most  part,  they  are  similar  to  conventional  computer  programs. 
Therefore,  it  is  logical  to  attempt  to  adapt  the  conventional  System 
Development  Life  Cycle  CSDLC)  to  derive  a  development  life  cycle  suited  to 
ESs.  Moreover,  the  peculiarities  of  ESs  do  not  affect  the  phases  of  the 
SDLC,  but  only  the  stages  into  %#hich  these  phases  are  divided.  For 
instance.  ESs,  like  conventional  programs,  still  require  analysis,  design, 
isplementation,  testing  and  maintenance.  However,  the  stages  into  which 
analysis  is  decomposed  are  different  for  ESs.  /ig.  S  shows  the  phases  of 
the  SSDLC  and  an  exploded  view  of  the  analysis  phase. 


Figure  5.  The  Phases  of  the  Expert  System  Development  Life  Cycle. 
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A  phased  davalopmant  has  ths  following  main  advantagss  1)  allows  for 
ths  bsttsr  SMinagsmant  of  ths  dsvslopmsnt  sffort  by  providing  clsar 
ailsstonssf  and  2)  sncouragss  a  clsar  ssparation  bstwssn  its  various  phases* 
For  sxamplsr  analysis  can  procssd  without  concern  for  design  and 
if^leoentation  issues.  In  a  XA  context,  this  decoupling  is  highly  desirable 
since  it  allows  the  knowledge  engineer  to  concentrate  all  his  efforts 
towards  the  analysis  of  the  expert's  knowledge.  Such  a  decoupling  is, 
however,  only  possible  if  knowledge  can  be  represented  in  an  implementation- 
independent  formalism  during  the  analysis  phase.  An  implementation- 
independent  formalism  is  a  notation  used  as  a  conceptual  aid  in  synthesising 
knowledge  from  the  expert  {14).  The  implmnentat ion- independent  formalism 
selected  for  this  KA  methodology  is  Systemic  Gramnar  networks  or  SC»,  first 
used  by  Johnson  and  Johnson  [U].  In  short,  a  SCH  is  a  graph  composed  of 
notes  end  links.  The  nodes  have  names  invented  by  the  knowledge  engineer 
but  suggested  by  the  data.  The  links  are  of  four  types,  namely  co¬ 
occurring,  mutually  exclusive,  recursive,  and  conditional.  A  SCH  is  drawn 
ia  a  later  section  to  illustrate  the  notation. 

Facllitatisg  KA  through  Frtelem-Solving  Models 

Facilitating  XA  is  most  likely  the  key  to  ensuring  a  wider  utilisation 
of  the  CS  technology  in  the  industry*  To  this  end,  modelling  appears  the 
more  promising  direction  in  which  to  proceed.  Consequently,  the  KA 
methodology  proposed  here  follows  this  trend.  For  instance,  the  methodology 
supposes  the  existence  of  a  limited  number  of  problem- solving  methods,  which 
can  be  used  to  structure  and  guide  the  elicitation  process.  On  the  other 
hand,  the  methodology  does  not  depend  on  a  KA  tool  for  the  acquisition  of 
knowledge  from  the  expert.  Both  the  knowledge  engineer  and  the  expert  play 
a  vital  role  in  this  KA  methodology.  The  next  section  discusses  the 
analysis  phase  of  the  ESDLC  in  more  detail. 
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tn  tMLXaiS  PHASE 

Thm  analysis  phase  of  the  proposed  XA  nethodology  includes  a 
feasibility  study,  task  analysis,  PS  nodal  selection,  knowledge  types 
Identification,  technique  selection,  knowledge  elicitation,  and  knowledge 
validation  as  shown  in  Plg«  S*  Each  of  these  stages  Is  now  discussed  In 
aoam  detail.  It  should  also  be  noted  that  esephasls  Is  placed  where  the 
proposed  XA  stethodology  differs  the  moat  from  previous  proposals* 

9ask  analysis 

Hollowing  commitment  to  the  project,  the  aim  of  the  task  analysis  Is 
to  litentlfy  the  PS  model  most  applicable  to  the  expert's  task*  To  this  end, 
a  taxonomy  of  task  types  is  a  useful  tool  because  it  provides  a  structured 
framework  which  can  be  used  with  consistency  in  the  cli^sslf Icatlon  of  tasks. 
The  tajconomy  sho%m  In  Pig*  €  la  baaed  on  Clancey'e  but  haa  been 
altered  in  t*JO  ways.  The  first  alteration  Involves  the  modify  task* 
miereas  Ciancey  regards  it  as  a  sut^type  of  smsomblo,  modify  Is  defined  here 
as  a  combination  of  identi/y,  design  and  oMoomblm  and  therefore  modify  la 
not  included  in  our  taxonomy.  The  second  alteration  concerns  th»  addition 
of  elMMsify^  which  categorises  a  systesi  based  on  observable  features,  and 
repair,  which  prescribes  remediee  for  Identified  discrepancies,  both  as  sub«- 
types  of  idmntify* 

The  task  analysis  Is  accomplished  In  an  interview  setting  bet%ifeen  the 
knowledge  engineer  and  a  doc&aln  expert.  Using  the  above  taxonomy  to  guide 
the  process,  the  knowledge  engineer  first  classifies  the  task  as  either 
analysis  or  synthesis.  The  task  characteristics  required  for  this  Initial 
classification  are  that  analysis  gener^  .ly  "^nvolvee  identifying  sets  of 
objects  baeed  on  their  features,  and  that ‘ synthesis  usually  requlrss  that 
a  solution  be  built  from  eub*problem  solutions.  To  sum  up,  this 
classification  procedure  Is  repeated  until  all  of  the  relevant  task 
characteristics  have  been  made  explicit  and  used  to  traverse  the  tree  shown 
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in  Fig.  6.  h  tank  in  elasnifiad  whan  a  taminal  noda  la  raachad. 


Figtwra  ♦.  A  Taxonowy  of  Tank  Typaa  (Adapted  froa  Clancay  X985). 


Frabia»*Solvift9  (FS)  Modal  Saiactioa  and  Inowiadga  Typaa  Xdantifieatioa 

One#  a  tank  typa  haa  baan  idantiflad,  tha  knowledge  engineer  proce»da 
to  determine  which  PS  modal  can  be  uaad  to  perform  a  tank  of  thin  typa. 
Mowewert  tha  amthcnJology  doea  not  yet  aupport  a  direct  mapping  between  tank 
typaa  and  FS  modaia«  for  the  aimpla  reason  that  a  taxonomy  of  FS  models 
which  coe^lataly  covers  the  above  taxonomy  of  task  types  doea  not  yet  exist. 
Mowever,  research  in  this  area  ie  continuing  and  should  eosM  day  allow  such 
a  mapping.  Fegardleaa,  the  proposed  XA  methodology  can  still  be  described 
using  the  FS  models  that  do  exist  for  the  diagnose  or  configure  tasks.  For 
illustrative  purpose,  the  diagnosis  FS  model  is  selected.  Xt  should  also 
be  noted  that  the  XA  methodology  ie  based  on  the  FS  model  description 
proposed  by  McDermott  [16]. 

Cover  end  differentiate  ie  the  PS  model  associated  with  the  diagnosis 
task.  This  FS  model  is  suitable  for  tasks  that  have  the  following 
character ist ice s 

1)  an  identifiable  set  of  symptoms  each  of  which  must  be  explained 
or  covered 

2)  an  exhaustive  set  of  candidate  explanations  that  cover  these 
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•ymptonfi  can  hm  pr»-«num«rat«d, 

3)  information  is  avaiXabla  which  halpa  diffarantiato  tha  candidate 
axplanationa  for  each  symptom ,  and 

4)  usually  only  one  candidate  explanation  is  applicable  for  any 
given  symptom* 

The  description  of  the  tasks  suitable  to  this  PS  model  highlights  the 
ceguirements  for  these  knowledge  types:  1)  symptoms#  2)  explanations  or 
possible  causes  for  these  symptoawi#  and  3)  differentiating  knowledge  or 
information  that  helps  differentiate  these  symptoms.  This  information 
facilitates  KA  by  providing  the  knowledge  engineer  with  an  indication  of  the 
knowledge  which  is  relevant  to  the  expert's  task,  additionally,  providing 
the  knowledge  engineer  with  the  right  tools  for  eliciting  this  relevant 
knowledge  should  snsure  that  the  KA  bottleneck  is  sffectively  removed  or  at 
the  very  least  widened. 

Blicitatiott  aad  Aaalysia  Techniguea 

The  KA  »sthodol(^  proposed  here  is  supported  exclusively  by  manual 
elicitation  techniques  et  this  time.  Although  the  trend  is  towards 
autosukted  KA,  it  is  believed  that  greater  efficiency,  especially  in  terms 
of  expert  utilisation,  can  be  achieved  through  the  use  of  appropriate  manual 
elicitation  techniques  and  alternats  knowledge  sources.  Another  important 
principle  In  thia  KA  mathodology  ie  that  the  use  made  of  a  piece  of 
knowledge  effects  considerably  the  format  in  which  it  ie  required.  1^ 
smthodology  doea  not  ignore  the  existence  of  a  domain  or  static  structure 
but  places  more  importance  on  the  task  or  dynamic  structure  of  the 
knowledge.  Moreover,  it  is  also  believed  that  the  format  in  which  the 
knowledge  is  required  directly  affects  the  techniques  which  should  be  used 
for  its  elicitation.  In  other  words,  for  each  PS  model  specific  knowledge 
types  are  required  which  neceasitate  the  use  of  different  knowledge 
elicitation  techniques.  Purthsr  dstail  on  ths  sllcltation  techniques  of 
this  methodology  are  now  presented  using  the  diagnosis  task  and  PS  model 
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Ml«ct«d  previously 


Ttm  first  knowlsdgs  type  required  by  the  cover  end  differentiate  PS 
aodel  is  e  set  of  symptoes.  Under  current  KA  eethodoloqies#  the  sost  likely 
siethod  for  obtsininq  this  infonsstion  is  to  ssk  the  expert  to  provide  e  list 
of  such  systptoM*  RoMver#  this  is  probably  not  the  sK>st  efficient  way  to 
proceed,  since  a  large  nueber  of  symptoos  nay  be  involved.  Moreover,  this 
is  a  rather  tedious  task  on  %«hich  the  expert's  time  is  essentially  wasted 
since  eo  specific  expertise  is  required  to  perform  this  activity.  Xn  this 
context,  the  proposed  XA  methodology  turns  to  three  alternate  sources  for 
this  knowledge.  Two  of  these  sources  are  essentially  documents  while  the 
ether  ie  not.  A  set  of  syn^osui  can  be  compiled  bys 

1)  querying  an  existing  information  system  |IS>  regarding  symptoms 
n^ported  by  users  or  customers,  snd 

2)  using  tN»  troubleshooting  manual  for  a  piece  of  equipsttnt  or 
eyntem. 

In  the  event  that  these  two  knowledge  sources  are  not  available,  the 
required  information  can  be  elicited  from  non^expert  dxagnosticiane  in  the 
dcxsain  using  questionnaires,  which  are  discussed  further  below.  As  stated 
ebove,  expertise  is  not  a  prerequisits  for  all  stages  of  the  XA  process. 
These  three  alternate  scxurcee  all  have  thm  advantage  of  not  requiring  the 
active  participation  of  the  expert  in  the  elicitation  of  an  initial  set  of 
eyeptome.  The  expert  participation  is,  in  fact,  limited  to  the  validation 
of  tills  set,  a  task  «#hich  is  a  lot  less  tine  consuming.  Moreover,  it  is 
also  possible  that  these  alternate  sources  may  produce  a  more  complete  set 
of  symptoms.  Zn  the  case  of  the  docxunsnts,  the  number  snd  range  of  symptoms 
elicited  can  easily  surpassed  that  of  one  expert.  A  situation  which  can 
also  be  duplicated  by  a  small  number  of  non*-expert  diagnosticians. 

Zn  cases  where  the  expert  must  be  involved,  the  methodology  suggests 
the  utilisation  of  indirect  as  opposed  to  direct  elicitation  techniques. 
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Two  such  tochniquM  nultablo  to  tho  •llcitAtion  of  this  knowlodg^  aro  X) 
quMtionnairM*  which  ara  ganaraXly  good  inatruaanta  to  uncovar  objacta  in 
a  doMtin  {X7]«  and  2)  an  unatructiirad  intarvlaw.  Quaationnairaa  ahouXd  ba 
conaidarad  fir at  bacauaa,  Xika  tha  pravloua  tachniquaa*  thay  can  ba 
diatributad  to  8»ra  than  ona  aapart  or  non-asrpart  and  tharafora  jraauXt  in 
a  battar  initiaX  aat  of  ayaptom.  additionalXy^  they  can  ba  fiXlad  out  in 
a  XaiauraXy  and  ralaxad  ataKvaphara^  i*a.  away  from  tha  aapart'a  placa  of 
worli.  Tha  unatructurad  intarviaw  ia  tha  onXy  aethod  propoaad  by  thia  KA 
Mthodology  whan  daaXing  diractXy  with  an  aapart.  Tha  ifitrnriaw  procaaa  ia 
faciXitatad  in  thia  caaa  by  uaing  aithar  tha  ayataa  or  a  atodaX  of  tha  ayataa 
aa  a  focoaing  davica  for  tha  alieitation.  for  aaartpla,  if  a  diagnostic 
ayataa  for  a  car  angina  ia  baing  buiXt  than  tha  angina  itaalf  or  at  Xaaat 
a  drawing  rapraaanting  that  angina  ahouXd  ba  uaad  in  tha  aXicitation  of  an 
initiaX  aat  of  ayseptoas. 

Ooaaring  kisowladga,  which  axpXaina  aach  aymptc^#  can  ba  aXicitad  in 
tha  aaM  ganaral  aannar  aa  an  InitiaX  aat  of  ayssptoaa.  Caution  ahoald  ba 
uaad,  hcmmvetrg  that  idantifiad  aaifunctiona  ara^  in  fact*  ralatad  to  a  given 
ayi^oa.  Thia  ia  aap«k:ially  iaportant*  for  aaa^la*  whan  querying  an 
•xiating  IS  for  aysseptona  and  eorraapcnding  aftaintenanca  actions.  These 
Mintananca  actions  aay*  in  fact*  hava  Xittia  to  do  with  tha  raportsd 
mympitomm  and  tha  danger  axiata  that  unsubst ant iat ad  ralationshipa  wiXX  ba 
MtabXiahad  bat%«sen  aynptoM  ar^  mX functions.  The  KA  Mthodology  also 
auggaats  thraa  additionaX  aXicitation  tachnigues  at  hia  ataga.  Thesa  era 
dividing  tha  doi&ain  (XSJ*  t^ra  thm  axpert  procaads  froa  obsarvabXa  symptoms 
to  a  MXfimction*  pure  racXaasif vcation  (XB)*  whara  tha  procass  is  from  tha 
Mifunction  to  its  symptoms*  and  finaXXy*  syst«natic  symptoms  to  malfunction 
Xinha  C^I»  wl^ra  a  list  of  malfunctions  and  sympto&is  is  usad  to  deteirmine 
tha  ralationshipa  that  axist  bat%faan  tha  malfunctions  and  tha  symptoms.  In 
thia  last  tachniqua*  a  list  of  malfunctions  must  first  ba  built. 
ConsaquentXy*  the  tachniqua  should  only  ba  used  after  the  first  two*  in 
order  to  gain  a  better  understanding  of  the  structure  of  the  dcHnain*  It 
should  ba  noted  that  all  these  techniques  take  advantage  of  the  fact  that 
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th.  initial  aat  of  aymptoma  can  ba  uaad  to  drive  tha  alicitatlon  of 
axplanatlona  for  thaa.  Thla.  in  turn,  highlight,  th.  laportanca  that  thl. 
initial  .at  of  ayaptoa.  ba  a.  coaplata  and  a.  valid  a.  po.albla.  Tha 
acgul.ltlon  of  an  initial  .at  of  .yaptoa.  and  of  tha  aalfunction.  explaining 
thaaa  ayaptoa.  provide,  th.  ...antlal  .tructur.  of  th.  ay.taa  under 


Olffarantiatlng  taowl«lg.  i.  .till  required  in  order  to  coaplata  the 
taowladg.  r^juireaant.  of  th.  cover  and  differentiate  PS  aodel.  Thl.  type 
of  knowl«ig.  1.  not  ...lly  .llclt«l  from  th.  expert,  becaua.  of  th. 
difficulty  that  th.  expert  ha.  .pacifying  preclaely  how  th.  inforaatlon 
provided  help,  the  differentiating  proce...  Differentiating  knowl^lg.  help, 
the  knowl«*ge  engineer  decide  which  of  two  explanation.  1.  the  correct  on. 
for  a  .yaptoa.  Therefore,  it  aeea.  that  thl.  type  of  knowl^ig.  ia,  in  fact, 
relat^J  more  directly  to  th.  ta.k  than  th.  domain,  or  1.  -ore  procedural 
than  declarative.  Con.equ.ntly,  the  KA  methodology  propo.a.  that  the 
elicitation  of  differ'-ntiating  knowledge  be  conducted  u.ing  procedural 
knowledge  elicttatloo  technique..  The  elicitation  technique,  proposed  by 
the  methodology  are  protocol  analy.i.,  goal  d.coapo.itlcn  [I],  and 
Betroepectiv.  ca.e  De.cription  C181.  Protocox.  ahould  be  tried  first 
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b«c4us«-  they  4r*  nost  likely  the  moat  efficient  technique  to  acquire 
procedural  knowledqe.  Thia  KA  methodoloqy  streasea  the  utilization  of 
concurrent  aa  oppoaed  to  retroapective  protocola,  in  which  there  ia  a  danger 
of  poat  hoc  rationalization.  Poet  hoc  rationalization  occura  when  the 
expert  in  an  effort  to  explain  hia  reaaoning  embelliahea  hia  deacription 
with  what  he  thinka  ahould  have  been  done  inatead  of  what  waa  done.  More 
apecifically,  two  protocol  techniquee  are  auggeated  and  ahould  be 
experimented  with.  Theae  are  the  technique  of  familiar  taaka  and  the 
technique  of  tough  caaea  (19).  It  ahould  be  noted  that  not  all  experta 
reapond  to  protocol  techniquea.  In  fact,  acme  training  may  be  required 
before  the  expert  feela  at  eaae  with  the  procedure.  If  for  aome  reaaona 
protocola  cannot  be  uaed,  th*  other  two  techniques  Hated  above  ahould  be 
tried,  starting  with  Retrospective  Case  Description.  A  summary  of  the 
elicitation  techniquea  proposed  by  the  KA  methodology  la  shown  in  Table  1. 
Above  all,  the  knowledge  engineer  ahould  be  flexible,  and  other  elicitation 
techniques  should  be  sought  if  the  expert  is  not  receptive  to  the  ones 
listed  in  Table  1.  The  selection  of  other  techniques  should,  however,  be 
baaed  on  the  fundamental  principle  which  the  methodology  atresaea,  that  ia 
the  efficient  utilization  of  the  expert  during  the  KA  process. 


Task  Type:  Diagnosis 

PS  Model:  Q>ver  and  DifTetentiate 

Knowledge  Types 

Elicitation  Techniques 

Synqrtoms 

1.  IS  Quay 

2.  Ttaublesbocvdog  Review 

3.  QuesUonsMSFca  to  fioa  expens  sod  expesti 

4.  UtetrocOiKd  Xiuaview 

MilfimctioQS 

t  IVcHdilesboQtma  Guide  Review 

2.  (juesdtmures  to  ooo  experts  and  expent 

3.  Dividing  the  dotoaiu 

4  Pora  R^lissificaiioo 

5.  SynesDslic  symptom  (o  Bulftmctioa  Unlo 

Diffetentudng 

Knowledge 

1.  Coocarreac  Pretocois 

2.  Retrospective  Cue  Desctipdoa 

3.  Goal  Dsocttpositioa 

Table  1.  Knowledge  Kllcitatlcn  Tschniques  proposed  by  the  KA  methodology 
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XAOwlsdg#  SXicitatiofi 


So  far,  tha  propotad  XA  mathodology  haa  addrataad  all  of  tha  stages 
Isading  to  knowledge  allcitation.  In  doing  so,  tha  aathodology  has 
anphasJtad  structure  and  guidance  as  thi*  key  to  success  in  XA.  Xnowledge 
elicitation  marks  a  turning  point  in  this  respect  for  the  methodology. 
Indeed,  the  methodology  holds  that  one  cannot  bluntly  ask  an  expert  to 
describe  his  expertise  and  domain  knowledge  and  expect  a  coherent  and 
organised  answer.  To  the  contrary,  hnowledge  elicitation  remains,  due  to 
the  eery  nature  of  knowledge,  an  iterative  process,  where  the  knowledge 
engineer  and  the  expert  actively  Interact  to  arrive  at  a  correct 
representation  of  the  expertise.  The  elicitation  process  requires  a  number 
of  sessions  and,  in  tnis  respect,  the  methodology  does  not  prescribe  a 
specific  plan  to  follow,  except  maybe  for  the  one  suggested  by  the  knowledge 
types  relevant  to  the  PS  model  which  is  described  briefly  in  the  previous 
section.  This  means  that  for  the  diagnosis  domain,  the  knowledge  engineer 
would  proceed  with  the  elicitation  of  an  initial  set  of  symptoms,  followed 
by  the  elicitation  of  explanations  for  these  symptoms.  Finally, 
differentiating  knowledge  would  be  elicited  from  the  expert- 

Knowledge  Validation 

Tha  final  analysis  stage  before  committing  to  design  is  one  of  the 
most  important  because  errors  made  early  in  the  analysis  are  usually  costly 
to  fix^  Knowledge  validation  in  the  proposed  methodology  is  facilitated  by 
two  factors,  first p  knowledge  elicitation  is  conducted  iteratively,  which 
means  that  both  the  knowledge  engineer  and  the  expert  use  the  mediating 
representation  extensively  during  knowledge  elicitation  with  the  result  that 
the  elicited  knowledge  is,  to  some  extent,  validated  through  the  elicitation 
process.  Second,  a  mediating  representation,  unlike  a  prototype,  is  free 
from  implementation  details,  and  therefore  much  closer  to  the^experfs 
representation.  This,  in  turn,  greatly  facilitates  knowledge  validation. 
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Th«  validation  tachniquaa  suggastad  hara  also  support  tha  afficiant 
utilisation  of  tha  oxpart,  a  fundamantal  principla  for  this  mathodology* 
for  axampla#  casas  which  ranga  from  tha  moat  to  tha  laast  common  ara  uaad 
to  avaluata  tha  complatanass  and  tha  accuracy  of  tha  alicitad  knowladga. 
Rnowladga  validation  should  also  ba  dona  with  non-^exparts  and  aspacially 
prospactiva  systam  usars.  Basidas  actual  casas,  tha  madiating 
raprasantation  can,  in  conjunction  with  guastionnairas,  ba  usad  for 
validation  purposa,  for  tha  raasons  given  above* 

ccmcwsxoif 

*•  • 

A  KA  methodology  based  on  PS  has  bean  prasantad*  Tha  methodology  uses 
tha  characteristics  of  tha  task  to  determine  first  the  PS  modal  which  bast 
resembles  tha  strategy  used  by  tha  expert  in  solving  problems  in  his  domain* 
furthermora,  this  PS  modal  suggests  tha  relevant  knowledge  types  as  well  as 
tha  general  structure  in  which  they  must  ba  represented  to  ba  useful  in 
solving  problems*  Based  on  this  information,  the  methodology  suggests 
appropriate  techniques  to  further  assist  the  knowledge  engineer  in  tha 
iterative  elicitation  of  tha  relevant  knowledge  types*  finally,  tha 
alicitad  «a)owledge  is  validated* 
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A  NEURAL  NETWORK  APPLICATION  TO  SEARCH  AND  RESCUE 
SATELLITE  AIDED  TRACKING  (SARSAT) 

Ivan  W.  Taylor*  and  Michel  O.  Vigneault* 

Abstract 

For  the  past  four  years,  the  Operational  Research  Advisors  at  Air 
Transport  Group  Headquarters  have  been  working  on  heuristic  methods  to  predict 
the  location  accuracy  category  of  SARSAT  hits  based  on  the  parameters  of  the 
Doppler  curve  fit  The  current  heuristics  that  have  been  developed  and 
frnplemented  work  reasonably  well  but  are  far  from  ideal.  They  consistently  have 
difficulty  identifying  very  good  solutions  when  they  occur  and  very  poor  solutions 
when  tfiey  occur.  Normal  data  fitting  techniques  based  on  multiple  linear 
regression  do  not  work  well  because  the  SARSAT  data  is  inherently  non-linear. 
Therefore,  neural  networks  were  applied  to  the  SARSAT  data  as  a  non-linear  data 
fitting  technique.  Altiiough  the  results  so  far  have  been  promising,  they  are  still  far 
from  ideal.  Other  artificial  intelligence  technologies,  such  as  fuzzy  logic,  inductive 
learning  and  expert  systems  are  being  investigated  to  enhance  the  neural  network 
approach. 


■Operational  Reseaich  Advisor,  k>peratianal  Research  Advisor  2,  Air  Transport  Group,  Air  Transport  Group 
Headquarters,  Astra,  Ontario 
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INTRODUCTION 

The  Search  and  Rescue  Satellite  Aided  Tracking  (S  ARSAT)  system  uses  polar-orbiting  satellites 
to  monitor  the  surface  of  the  earth  for  Emergency  Locator  Transmitters  (ELTs).  If  one  is  detected,  its 
signal  is  retransmitted  to  ground  facilities,  called  Local  User  Terminals  (LUTs).  for  processing.  The 
location  of  the  ELT  is  determined  by  fitting  a  Doppler  curve  to  the  signal  and  this  location  estimate 
is  sent  to  the  Mission  Control  Center  (MCC)  for  retransmission  to  a  foreign  MCC  or  a  national  Rescue 
Coordination  Center  (RCQ  for  action  (see  Figure  1). 

When  the  SARSAT  system  was  flist  introduced  in  Canada  in  1985,  it  suffered  a  number  of 
growing  pains.  One  particular  problem  was  false  alerts  on  the  121.5  MHz  frequency  which  were  aused 
by  spurious  voice  communication  on  the  channel  even  though  it  is  supposed  to  be  reserved  for 
emergenc;  broadcasts.  The  Operational  Research  Branch  at  Air  Transport  Group  worked  on  a  filtering 
procedure  to  saeen  out  these  false  alerts  and  prioritize  the  ELT  signals.  This  resulted  in  the 
•confidence  factor*  method.  The  confidence  factor  was  also  useful  as  a  predictor  of  the  accuracy  of 
the  location  estimate.  Studies  in  1987  and  1988  (1.  2  and  3)  developed  and  refined  a  heuristic  based 
on  the  Doppler  curve  fit  parameters.  This  heuristic  was  later  Implemented  in  the  LUT  software. 

Unfortunately,  the  current  heuristic  is  not  well  understood.  It  is  based  on  empirical  data  rather 
than  a  sound  theoretical  foundation  and  the  results  arc  far  from  ideal.  Any  new  method  should  have 
better  performance,  be  easier  to  understand  and  have  a  more  rigorous  theoretical  foundation.  A  new 
method  will  be  considered  in  this  report  based  on  the  artificial  intelligence  technique  ailed  neural 
networks  (4J.  We  have  obtained  a  program  developed  by  Dr.  Simon  Barton  from  Defence  Research 
Establishment  Suffield  which  simulates  a  small  neural  network  15].  We  will  ’train’  the  neura!  network 
on  a  sample  of  173  observations.  Then  we  will  ’test’  the  method  on  a  sample  of  172  different 
ot>scrv3tio(is  3nd  compsrc  the  results  to  the  current  method* 


FIGURE 
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MODEL  COMPARISON  METHOD 

The  confidence  factor  (CF)  method  that  has  been  Implemented  Is  tied  to  the  International 
Teiecommunicatiou^  Union  (ITU)  standards  for  reporting  position  error 

1,  CF«4,  category*  within  5  nm; 

b.  CF»3,  'B'  category,  within  20  nm; 

c  CF«2,  *C  category,  within  50  nm;  and 

d.  CF«1,  *0*  category,  greater  than  50  nm  in  error. 

We  will  combine  the  'C  and  *D'  categories  to  Increase  our  sample  size  for  this  subset  and  define 
it  as  'errors  greater  than  20  nm’.  The  confidence  factor  methods  will  attempt  to  predict  the  location 
error  category. 

In  [6],  we  developed  a  statistical  technique  for  evaluating  the  accuracy  of  a  confidence  factor 
method  for  a  set  of  observations.  We  first  divided  the  data  set  into  four  overlapping  subsets  based  on 
the  actual  location  error;  very  good  solutions  (less  than  5  nm  in  error),  good  solutions  (less  than  20 
nm  in  error),  poor  solutions  (greater  than  5  nm  In  error)  and  very  poor  solutions  (greater  than  20  nm 
in  error).  Notice  very  good  solutions  are  also  good,  very  poor  solutions  arc  also  poor,  and  some  good 
solutions  can  be  considered  poor  depending  on  your  point  of  view  (see  Figure  2). 

We  can  display  the  accuracy  of  the  confidence  factor  method  by  plotting  the  percentage 
of  the  time  good  (and  very  good)  solutions  are  identified  when  they  occur  against  the  percentage  of  the 
time  very  poor  (and  poor)  solutions  are  identified  when  they  occur.  If  the  confidence  factor  method 
calls  a  good  solution  very  poor,  or  a  very  good  solution  poor,  we  call  that  a  Type  I  mistake  (or 
underconfidence).  If  the  confidence  factor  method  alls  a  poor  solution  very  good,  or  a  very  poor 
solution  good,  v>e  all  that  a  Type  II  mistake  (or  overconfidence).  This  dichotomy  is  similar  to 
producer’s  and  consumers’  risk  in  industrial  testing  [7).  When  these  values  are  plotted,  we  an  easily 
determine  an  ideal  confidence  factor  model  from  an  underconfident,  overconfident  or  just  plain  poor 
model  (see  Figure  3). 
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THE  DATA 


For  each  observation,  we  have  nine  independent  variables  and  one  dependent  variable.  The 
following  desaiption  of  the  independent  variables  is  taken  from  [2]: 

Tv  stellite  (SAT),  There  arc  four  different  satellites. 

'  '  •  c 

b.  Major  and  Minor  Axes  ^MAJ  and  MINV  Th»jsc  arc  the  major  and  minor  axes  of  the 
estimated  error  ellipse.  They  arc  used  together  with  the  angle  of  inclination  of  the 
major  axis  with  respect  to  true  north  to  give  an  area  in  which  the  ELT  is  presumably 
located  a  certain  percent  of  the  time. 

c  The  probability  (PROBV  This  is  the  probability  that  the  solution  identified  is  the 
correct  one  and  not  its  image  with  respect  to  the  satellite  track. 

d.  Bias.  Bias  is  the  difference  in  signal  frequency  of  the  beacon  from  the  121.5  MHz 
standard  frequency.  U  is  useful  when  wanting  to  combine  several  detections  from  the 
same  area  into  one  case.  If  the  bias  from  two  detections  arc  within  .600  KHz,  and 
from  the  same  area,  they  will  be  merged  into  one  case. 

c.  Cross  Track  Angle  (CTA\  CTA  is  a  measure  of  the  angle  between  the  satellite's 
orbital  plane  and  a  vector  from  the  centre  of  the  earth  to  the  ELT  at  the  time  the 
spacecraft  is  closest  to  the  beacon.  A  CTA  close  to  0®  occurs  when  the  satellite  passes 
almost  directly  overhead,  whereas  CTAs  greater  than  16®  arc  near  the  satellite’s 
horizon. 

t  Standard  Deviation  fSDEVl.  SDEV  is  a  measure  of  how  well  the  frequency  data 
composing  a  Doppler  curve  fits  the  model  equation  defining  it.  It  could  probably  be 
more  accurately  defined  as  a  goodness  of  fit  measure,  with  the  smaller  the  SDEV,  the 
better  the  fit. 

g.  Number  of  Points  (NPTS).  NPTS  is  directly  related  to  how  long  the  signal  was 
tracked.  For  121.5  MHz  signals,  one  point  is  generated  every  two  seconds  the  signal 
is  tracked.  Once  the  LUT  loses  the  signal,  all  of  the  points  are  used  to  make  up  one 
detection. 


h.  Normatized  Quality  Factor  fNQR.  NQF  is  the  ratio  of  Quality  Factor  (QF)  :o  NPTS, 

where  QF  is  a  function  of  the  strength  of  the  signal  and  the  length  of  time  that  the 
signal  was  received. 

The  dependent  variable  is  the  location  error  category. 

PERFORMANCE  OF  THE  CURRENT  METHOD 

Our  data  set  consists  of  345  observations:  150  (4391’)  less  than  5  nm  in  error;  129  (37%) 
between  5  and  20  nm  in  error.  66  (19%)  greater  than  20  nm  in  enor.  We  will  divide  this  into  two 
separate  sets:  a  training  set  consisting  of  the  first  173  observations  and  a  test  set  consisting  of  the  next 
172  observations.  Table  I  shows  the  classification  of  test  data  using  the  current  method. 


TABLE  1 


CLASSIFICATION  OF  TEST  SET  BY  CURRENT 


actual  category 

TOTAL 

A 

<5nm 

B 

5<  <20nm 

CD 

>20nm 

PREDICTED 

*CF*4 

26 

12 

2 

40 

1  CATEGORY 

CF«3 

37 

43 

16 

96 

1 

CF*2,1 

4 

13 

19 

36 

1 

TOTAL 

67 

68 

37 

.■?Zl 

As  expected,  the  current  method  does  much  better  than  a  random  assignment  based  on  the 
relative  distribution  of  the  solutions  by  location  error  category.  Table  II  shows  the  percentages  that 
would  be  expected  from  a  random  assignment.  Table  III  shows  the  percentage  obtained  by  the  current 
confidence  factor  method.  The  higher  values  on  the  diagonal  in  Table  III  compared  to  Table  11  show 
that  the  current  method  is  working. 

Table  IV  shows  the  accuracy  of  the  current  method  in  terms  of  Type  I  accuracy  and  TVpe  II 
accuracy.  Table  V  provides  95%  confidence  intervals  on  the  accuracy  using  the  technique  described  in 
[8).  Figure  4  shows  the  accuracy  of  these  results  graphically.  We  can  see  that  the  current  method  has 
difficulty  distinguishing  very  good  solutions  when  they  occur  (39%  accuracy)  and  also  has  difficulty 
identifying  very  poor  solutions  when  they  occur  (51%  accuracy).  For  the  5  nm  breakpoint,  the  current 
method  is  undcrconfident  and  for  the  20  nm  breakpoint  the  current  method  is  overconfident  This  is 
an  undesirable  situation. 
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TABLE  It 

EXt>ECTED  PERCENTAGES  THAT  WOULD  BE 
OBTAINED  BY  RAuNPOM  ASSIGNMENT 

actual  CATEGORY 


I  1  <5nm 

5<  <20nm 

>20nm 

PREDICTED  BY 

<5 

15.2 

!5.4 

8.4 

RANDOM 

5<  <20 

15.4 

15.6 

8.5 

ASSIGNMENT 

>20 

8.4 

8.6 

4.6 

TABLE  III 

PERCENTAGES  OBTAINED  BY  CURRENT 
CONFIDENCE  FACTOR  METHOD 

ACTUAL  CATEGORY 


PREDICTED 

CATEGORY 


<5nm 

5<  <20nm 

>20nm 

<5 

15.1 

7.0 

1.2 

5<  <20 

21.5 

25.0 

9.3 

>20 

2.3 

7.6 

11.0 

TABLE  iV 


accuracy  OF  CURRENT  CONFIDENCE  FaCTOR  METHOD 


SOLUTIONS  <5NM  IN  ERROR 


TOTAL  CORRECT 
CF-4 


UNDER¬ 

CONFIDENT 

CF=3.2.1 


SOLUTIONS  >5NM  IN  ERROR 
TOTAL  OVER-  CORRE 


OVER¬ 

CONFIDENT 

CF=4 


CORRECT 

CF=3.:.I 


SOLUTIONS  <20NM  IN  ERROR 

TOTAL  CORRECT  UNDER- 
CF-43  CONFIDENT 
CF=2a 


105  14  91 

_ I  (86.7%) 

SO LLITIONS  >20NM  IN  ERROR 


TOTAL 


OVER¬ 

CONFIDENT 

CF=4.3 


CORRECT 
CF=?  1 


GOOD  (VERY  QCOO)  iDENTIf ICATGN  ACCURACY 


Figure  4:  Performance  of  Current  Method  on  Test  Data 
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li  is  apparent  from  these  results  that  the  current  method  leaves  much  room  for  improvement. 
We  will  now  develop  a  neural  network  for  predicting  location  error  category  based  on  the  training  set 
Then  we  will  examine  the  ability  of  the  neural  network  model  to  generalize  to  new  cases  by  applying 
it  to  the  test  set  and  compare  the  neural  network  results  to  the  results  of  the  current  method. 

PREDICTING  LOCATION  ERROR  CATEGORY 

One  problem  should  be  noted.  The  neural  network  method  proouce  numbers  with  a  fractional 
component.  The  actual  category,  on  the  other  hand,  is  an  integer.  Therefore  we  must  convert  these 
predictions  to  Integers,  After  considerable  thought,  we  decided  to  simply  round  the  prediacd  values. 
Therefore  a  predicted  value  of  3.9  would  be  rounded  to  4  and  a  predicted  value  of  3.4  vwtuld  be  rounded 
to  3.  However,  since  we  have  grouped  category  C  and  D  together,  we  vyill  call  all  predicted  values  less 
than  2.5. 2.  Similarly,  any  prediction  greater  than  3.5  will  be  called  4. 

A  neural  network  model  was  developed  using  the  173  observations  training  set.  When  this 
model  was  used  to  classllV  the  observations  in  the  test  set.  the  resulu  were  as  shown  in  Table  VL 
Tables  VII  and  VIII  provide  more  details  on  the  accuracy  of  the  neural  network  method.  Rgure  5 
shows  the  accuracy  of  these  results  graphically. 

I"**  TABLE  VI  _ :  ZJ 

NEURAL  NETWORK  RESULTS  FOR  TEST  SET  | 


PREDICTED 

CATEGORY 

TOTAL 


A 

<6 

ACTUAL 

CATEGORY 

B 

5<<20 

CX> 

>20 

TOTAL 

II 

t 

15 

7 

66 

(25.6) 

(8.7) 

(4.1) 

CF-3  21 

43 

14 

78 

(12.2) 

(25.0) 

(8.1) 

CF-U  2 

10 

16 

28 

(1.2) 

(5.8) 

(9.3) 

67 

68 

37 

172 
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_ TABLE  Vll _ _ 

ACCURACY  OF  NEURAL  NETWORK  METHOD 


SOLUTIONS  <5NM  IN  ERROR 


TOTAL  CORRECT 
CF-4 


UNDER. 

CONFIDEOT 

CF-3.2.1 


SOLUTIONS  >5NM  IN  ERROR 
TOTAL  OVER-  CORRE 


OVER¬ 

CONFIDENT 

CF-4 


CORRECT 

CF-3Z1 


SOLUTIONS  <20NM  IN  ERROR 


TOTAL  CORRECT 
CF-44 


UNDER. 

CONFIDENT 

CF-2.1 


SOLUTIONS  >20NM  IN  ERROR 

TOTAL  I  OVER.  1  CORRE( 


OVER. 

CONHDENT 

CF-4.3 


CORRECT 

CF-2.1 


TABLE  VIII 

"1  '  "■  ..itiLjB*' )IWB.«WBPW<WWIWII 

CONHDENCE  INTERVALS  ON 
NEURAL  NETWORK  ACCURACY 


SOLUTION 

CATEGORY 

LOWER 

BOUND 

ESTIMATE 

UPPER 

BOUND 

<5nm  in  Error 

53.06 

65.67 

76.35 

>5nm  in  Error 

70.01 

79.05 

86.38 

<20nm  in  Error 

34.99 

91.11 

95.32 

>20nm  in  Error 

27.10 

43.24 

60.51 

As  we  can  see  from  Figure  5,  the  neuraJ  network  model  performed  quite  well  cn  the  ie5t  set. 
In  fact,  the  network  results  are  significantly  better  at  identifying  very  good  solutions  when  they 
occur  (less  underconfidence).  That  is,  when  we  compare  the  *<5  nm"  results  for  the  current  method 
(Table  V)  and  for  the  neural  network  method  (Table  VIII),  we  see  that  the  confidence  intervals  do  not 
overlap  which  indicates  a  statistically  significant  improvement.  None  of  the  other  differences  are 
statistically  significant. 

The  neural  network  model  based  cn  location  error  ategory  shows  promise.  The  results  appear 
to  demonstrate  a  significant  improvement  in  Type  I  accuracy  for  very  good  solutions  (i.e.  reduction  in 
underconfidence)  without  a  reduction  in  Type  II  accuracy  (i.e.  without  introducing  more 
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overconfidence).  Although  the  results  arc  still  far  from  the  Ideal,  this  area  of  research  should  be 
pursued  with  more  sophisticated  tools  and  larger  data  sets. 


GCXDD  (VERY  GOOD)  IDENTIFICATION  ACCURACY 
Figure  S:  Performance  of  Neural  Network  Method  on  Test  Data 


CONCLUDING  REMARKS 

We  found  that  the  current  confidence  factor  method,  although  performing  better  than  random 
assignment,  has  the  undesirable  characteristic  that  it  has  difficulty  identifying  very  good  solutions  or  very 
poor  solutions  when  they  occur. 

We  examined  a  new  methodology  based  on  neural  networks.  The  neural  network  method 
showed  significantly  improved  ability  to  identify  very  good  solutions  when  they  occurred  compared  to 
the  current  method.  It  did  not,  however,  produce  improvements  in  terms  of  identifying  very  poor 
solutions  when  they  occur.  Although  the  neural  network  results  show  promise,  it  is  still  far  from  the 
ideal. 

A  consultant  company.  ABIT  Systems  Inc,  has  proposed  a  research  contract  to  apply  interal 
mathematics  (fuzzy  set  theory)  and  inductive  learning  as  preprocessing  before  applying  neural  networks 
to  this  problem  [9].  These  more  sophisticated  techniques,  which  are  not  currently  a\^ilable  to  the 
Operational  Research  Advisor,  may  enhance  the  modest  improvements  that  have  been  demonstrated 
in  our  research  and  may  take  us  another  step  towards  an  ideal  system. 
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INSPECTION  OF  DNO  WARREN  TRUSS  BUILDINGS  USING  KBES  IN  A 
WINDOWING  ENVIRONMENT 

H.  C.  Fu'  and  Q.  Akhras* 

Abstract 

The  Department  of  National  Defence  (DNO)  has  over  two  hundred  timber 
Warren  truss  hangars  throughout  the  country.  The  roof  of  these  structures  is 
supported  by  timber  Warren  trusses.  These  structuf  es  were  built  in  the  early  1940’s 
and  are  showing  signs  of  deterioration.  In  order  to  properly  maintain  these  aging 
structures,  regular  inspections  by  military  engineers  and  technologists  to  assess 
their  structural  behaviour  are  required. 

Inspection  of  a  building  often  requires  following  guidelines  and  applying 
heuristic  knowledge  such  as  experience  and  rulss  of  thumb.  EJecause  of  the  nature 
of  the  Inspection  process  and  all  the  heuristic  knowledge  that  Is  associated  with 
ft,  Warren  truss  Inspection  lends  Hself  well  to  an  expert  system  application. 

The  development  of  a  knowledge  based  expert  system  for  the 
maintenance  of  timber  Warren  trusses  is  now  underway.  The  system  combines 
expert  system  technologies,  object-oriented  programming,  relational  database 
models  and  hypertext/graphics  in  a  windowing  environment  This  paper  presents 
a  brief  insight  Into  the  strategy  and  technique  used  In  the  development  of  the 
system.  Two  sample  consultations  are  given  to  demonstrate  the  capabilities  of  the 
system. 


'Research  Engineer,  ^Associate  Professor,  Dept  of  Civil  Engiiteering,  RMC.  Kingston,  Ontario 


INTRODUCTION 


An  expert  system,  also  known  as  knowledge-based  expert  system  (KBES),  can  be 
considered  as  a  computer  program  that  captures  human  knowledge  and  decision  making 
proces^js.  An  expert  system  has  two  basic  components:  a  knowledge  base  and  an  inference 
engine.  The  knowledge  obtained  from  the  human  expat  or  experts  comprises  information 
specific  to  the  domain  of  the  problem  being  addressed  and  is  captured  in  the  knowledge 
base.  The  inference  engine  interprets  and  applies  the  knowledge  ba.se  and  attempts  to  make 
decisions  to  problems  that  would  ordinarily  require  a  human  expert.  Fully  developed  expert 
systems  are  capable  of  accepting  facts  from  the  user,  processing  these  facts  against  the 
knowledge  base.  and.  on  the  basis  of  these  facts  and  knowledge,  making  conclusion  which 
are  close  to  the  conclusion  of  a  human  expert. 

Applications  of  expert  system  technology  can  be  dated  back  to  the  mid- 1970  s. 
MYCIN  [91.  widely  regarded  as  the  first  successful  expert  system,  was  developed  at 
Stanford  University  to  help  diagnose  and  treat  glaucoma-related  infections.  Since  then, 
expert  systems  have  been  used  in  a  wide  variety  of  domains  ranging  from  medical 
diagqfvei<  to  military  strategic  assessment,  and  from  nuclear  reactor  control  to  information 
management.  The  potential  uses  of  expert  systems  appear  to  be  virtually  limitless.  The 
recent  interest  and  potential  prospects  in  the  development  and  application  of  the  expert 
system  technology  in  the  fields  of  engineering  are  both  enormous  [1,3.6]  and  growing 
rapidly. 

A  system  for  the  overall  management  of  timber  Warren  truss  structures  is  being 
developed  by  the  KBES  Group  of  the  Department  of  Civil  Engineering  at  the  Royal 
Military  College  of  Canada  [21.  This  system  has  many  sub-systems  related  to  the 
maintenance  of  all  DND  timber  Warren  truss  buildings.  One  of  which  is  the  diagnosis  or 
inspection  of  the  trusses.  TTie  principle  objective  of  the  inspection  process  is  to  determine 
the  appropriate  action  required  to  repair  defective  members  of  the  structure.  Some  of  the 
solution  sttategies  and  development  techniques  of  the  system  are  presented  in  this  paper. 
Two  sample  sessions  are  included  to  demonstrate  the  capabilities  of  the  system. 
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TIMBER  WARREN  TRUSSES 


DND  owns  many  hangar  type  timber  Warren  truss  structures  on  CF  bases 
throughout  the  country.  These  Warren  truss  buildings,  built  during  and  soon  after  World 
War  n  to  meet  the  needs  of  the  expanded  Armed  Forces  establishment,  were  constructed 
as  temporary  structures  and  were  used  by  the  military  mainly  for  aircraft  housing  and 
maintenance.  It  is  estimated  that  across  Canada,  there  are  more  than  two  hundred  of  these 
‘temporary’  buildings  still  standing. 

The  buildings  were  designed  and  built  in  two  truss  configurations,  namti  an  eight- 
panel  pitched  chord  truss  and  a  seven-panel  parallel  chord  truss.  The  overall  configurations 
of  the  two  types  of  trusses  were  standardized  with  a  span  of  34.16  m.  A  standard  building 
has  eleven  such  trusses  spaced  at  4.88m  for  a  total  length  of  43.8  m.  Fig.  1  shows  a  double 
Warren  truss  with  the  seven-panel  parallel  chord  co^guration. 

There  ate  three  types  of  buildings  branching  from  the  two  truss  types:  single 
pitched,  single  parallel  and  double  parallel  buildings  in  which  tw  --  ■*  4g!e  parallel  chord 
trusses  were  joined  together  side  by  side  sharing  a  central  colum.;  T'  an  view  of  a  typical 
double  parallel  building  is  illustrated  in  Fig.  lb.  Only  a  few  of  the  hangars  still  standing 
today  used  the  pitched  Warren  truss  and  they  all  are  single  span  buildings. 


Due  to  thi  large  number  of  buildings  involved  and  the  urgent  demand  for  timber, 
improperly  cured  timber  was  used  in  some  structures.  Within  the  first  few  years  of  service 
and  after  the  timber  dried  out,  the  trusses  began  to  show  signs  of  distress  due  to  shrinkage. 
The  resulting  structural  deficiencies  included  cracking  and  splitting  of  truss  or  splice 
members,  fracture  of  truss  members,  excessive  deformation  of  trusses  and  loss  of  camber. 

Shortly  after  World  War  II,  the  structural  deficiencies  were  recognized  and  a 
program  of  rehabilitation,  repair  and  reinforcement  was  established.  Structural  analysis  of 
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1.  Location  and  configuration  of  tie  rod  bi 
diagonal  bracing  varies  from  building  tc 

2.  The  number  of  trusses  varies  from  buii 

(b)  Plan  view  of  a  double  parallel  W 


Fig.l  A  Double  Width 
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the  truss  indicated  that,  for  buildings  uhere  the  live  load,  ntainly  the  roof  snow  load,  was 
high,  the  truss  end  panels  and  the  bottom  chord  v/ere  overstressed.  A  system  of 
strengthening  by  post-tensioning  the  Warren  trusses  was  introduced  to  relieved  some  of  the 
stresses  in  these  areas  (Fig.  la). 

To  avoid  inconsistent  results  and  to  eliminate  considerable  duplication  of  effort, 
DND  establi^ed  guidelines  and  direction  for  the  assessment,  repair  and  maintenance 
processes  of  Warren  truss  buildings.  It  was  this  policy  that  led  to  the  publication  of  the 
Construction  Engineering  Technical  Order,  or  CETO  [4].  CETO  was  first  published  in  1967 
and  later  updated  in  1988. 

CETO  can  be  considered  as  a  three-pan  maintenance  manual.  The  first  part  provides 
instructions  for  dte  inspection  of  Warren  truss  buildings.  The  second  part  provides 
guidelines  for  determining  the  necessary  reinforcement  work  in  upgrading  an  existing 
Warren  truss  building  to  meet  the  requirements  of  the  National  Building  Code  of  Canada 
(81.  The  last  part  of  CETO  jwjvide®  specifications  for  the  repair  and  reinforcement  work 
required  because  of  the  current  or  existing  condition  -if  the  building. 

The  process  of  inspecting  a  building  as  outlined  in  CETO  often  require.s  following 
guidelines  and  applying  heuristic  knowledge  such  as  experience  and  rules  of  thumb.  Over 
the  years,  DND  has  developed  the  necessaty  knowledge  and  structural  techniques  adapted 
specifically  to  timber  Warren  trusses.  This  accumulating  expertise  is  dispersed  among  very 
few  enginews  and  technologists.  Extensive  consultation  is  often  required  to  reach  an 
appropriate  decision.  In  addition,  DND  does  not  have  sufficient  personnel  with  necessary 
knowledge  to  cany  out,  as  often  as  needed,  the  task  of  inspecting  deteriorating  buildings. 

KBES  IN  WINDOWS  ENVIRONMENT 

An  expert-systems  development  software  called  Levels  Object  [5]  is  used  to  develop 
a  knowledge  based  expert  system  for  the  inspection  of  timber  Warren  trusses.  The  system 
combines  expert  system  technologies,  object-oiented  programming,  relational  database 
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models  and  hypertext/graphics  capabilities  in  a  flexible  windowing  environment 
Object-Oriented  Programming 

Levels  Object  is  an  object-oriented  expert  system  development  shell,  combining  the 
versatility  of  object-oriented  techniques  with  multiple  inferencing  strategies  in  windowing 
environment  It  provides  an  interactive  windows-based  user  interface  integrated  with 
Production  Rule  Language  (PRL),  one  of  the  many  knowledge  representation  schemes  used 
in  expert  systems. 

In  object-oriented  environment,  the  classification  and  organization  of  data  within 
a  software  application  are  modeled  in  the  same  way  «s  human  normally  classify  and 
organize  knowledge.  Data  and  programs  are  represented  as  objects.  In  other  words,  an 
ot^ect  is  the  sum  of  its  data  and  procedures.  Instead  of  passing  data  as  parameters  as  in 
conventional  programming  environment,  the  objects  perform  operations  on  themselves. 

Objects  are  definitions  of  database-like  entities  with  associated  relationship 
references,  procedures,  and  actions.  An  object’s  structure  is  defined  by  its  class  and 
attribute  declarations.  An  instance  is  a  specific  ocaurence  of  a  class  and  holds  data  values 
of  its  attributes.  Fig.2  depicts  the  structural  breakdown  of  a  Levels  Object  object. 

To  understand  and  process  a  vast  amoimt  of  information,  objects  are  grouped  into 
a  class  which  defines  the  properties,  inheritance,  and  attributes  of  an  ol^ect.  Properties  of 
a  cljigg  define  its  inheritance,  its  source  and  whether  it  is  limit«l  to  a  single  or  multiple 
instances. 

A  class  describes  the  structure  and  behaviour  of  an  ol^ect  within  an  application  and 
I  is  defined  by  a  collection  of  characteristics  called  attributes.  Levels  Object  attributes  consist 

of  a  name,  a  type,  facets,  methods,  rule  group  and  demon  group.  Attribute  type  specifies 
the  type  of  information  associated  with  the  class  such  as  numeric  data,  a  true/false 
statement  or  graphics  data  that  constitutes  a  picture.  Facets  control  how  the  inference 
engines  process  and  use  attribute.  Methods  establish  developer-defined  procedures 
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OBJECT 


CLASS 


INSTANCE 


PROPERTIES 


ATTRIBUTES 


VALUES 


PAC6TS  1  f  METHODS!  f  RULES 


DEMONS 


Fig.  2  Components  of  a  LevelS  Object  obje« 


associated  with  each  attribute.  Rule  group  uses  backward-chaining  rules  to  conclude  the 
same  attribute.  Demon  group  uses  forward-chaining  demons  to  reference  the  same  attribute. 


)biected-Oriented  Database  Management 


Levels  Object  supports  direct  access  to  external  programs  and  databases  with  a 
management  system  that  mtegrates  and  controls  the  interaction  between  the  knowledge  base 
and  the  database  files.  Direct  database  access  enables  Levels  Object  to  read  and  write  to 
files  directly  from  within  the  knowledge  base.  Levels  Object  views  these  databases  as 
objects,  which  are  referenced  and  manipulated  with  standard  PRL  grammar. 


Windows  Environment 


Levels  Object  jxovides  an  interactive,  windows-based  graphical  user  interface. 
Applications  developed  with  LevelS  Object  run  under  and  follow  the  conventions  of 
Microsoft  Windows  [7].  The  user  interface  is  invoked  through  Microsoft  Windows  and  runs 
in  a  fully  triggered  environment.  Pointing  and  clicking  an  icon  or  rule  name  automatically 
activate  the  appropriate  editor  or  browser.  Clicking  on  a  hypetregicn  gives  end  users 
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auxiliary  text  and  graphic  information  as  needed. 

Using  the  clipboard  of  Windows  to  transfer  files,  paints  and  graphics  can  be 
incorporated  into  a  Levels  Object  display.  Levels  Object  can  also  display  photo  or  graphic 
images  from  image  files  created  by  other  image  processing  software  as  long  as  these  files 
are  compatible  with  Microsoft  Windows. 

Levels  Object  also  supports  the  hypermedia  paradigm.  By  clicking  on  a  hyperregion 
in  a  window  or  dialogue  box.  another  window  can  be  opened  containing  additional 
information  in  text  and  graphic  formats. 

KBES  FOR  THE  INSPECTION  OF  DND  WARREN  TRUSS  BUILDINGS 
The  Objective 

To  accommodate  the  nature  of  maintenance  of  a  timber  Warren  trus.s,  a  knowledge- 
based  expert  system  for  the  diagnosis  of  the  trusses  is  being  developed.  This  system  groups 
many  sub-systems  related  to  the  diagnosis,  repair  and  database  management  of  the 
rehabilitation  history  of  these  buildings.  The  scope  of  this  project  belongs  to  the  class  of 
jntfgrat*^  systems  which  includes  many  independent  but  related  sub-systems,  and  which 
needs  continuous  development,  updating  and  revision. 

Expert  knowledge  on  Warren  truss  inspection  is  held  by  a  few,  and  among  them, 
no  one  has  an  in-depth  knowledge  of  the  whole  field.  The  system  is  intended  to  be  used 
as  a  guide  for  the  user,  either  experienced  or  novice,  throughout  the  inspection  process. 
Implementation  of  the  system  reduces  the  dependence  on  specialist  staff  for  routine 
Inspection  work  and  serves  to  transfer  the  diagnosis  knowledge  from  the  experts  to  local 
maintenance  personnel  as  weU  as  among  the  experts  themselves. 

The  System 

The  system  is  being  developed  to  tun  on  personal  computers  using  the  expert 
system  shell  Levels  Object  which  operates  under  Microsoft  Windows  environment.  The 
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system  can  be  compiled  and  encrypted  to  create  a  run-only  system.  The  run-only  system 
can  then  be  delivered  to  the  end  users  as  the  completed  application.  This  run-only  system 
is  smaller,  more  efficient  and  portable. 

The  knowledge  is  drawn  mainly  from  the  maintenance  manual.  i.e.  CETO.  and  from 
several  engineers  who  were  previously  or  are  presently  involved  with  the  inspection  and 
the  evaluation  of  the  structural  beha-nour  of  these  structures.  Using  Levels  Object,  the 
domain  experts’  knowledge  are  translated  into  rules  and  facts  while  following  a  special 
syntax.  The  same  group  of  experts  from  whom  heuristic  knowledge  is  drawn,  will  also  be 
involved  in  the  process  of  testing  and  validating  the  system. 

Facts  required  by  the  system  is  die  user’s  visual  observations  input  by  answering 
questions  related  to  each  element  The  system  interfaces  to  the  user  and  has  an  efficient 
explanatory  component  to  make  the  comprehension  and  checking  of  how  a  solution  is 
reached  possible  and  effective.  After  putting  facts  into  the  system,  the  user  receives 
and  recommendations  and  the  user  is  responsible  for  making  use  of  it 

The  ouqjut  lists  the  recommendations  for  action.  They  includes  identifying  all 
members  requiring  replacement  or  repair  along  with  the  reasoning  for  the  remedial  action. 
Because  the  main  source  of  knowledge  of  this  system  is  the  maintenance  manual,  specific 
references  to  particula  explanations  and  details  in  this  manual,  if  needed,  are  provided  to 

assist  the  user. 

EXAMPLES 

If  an  expert  system  is  to  be  accepted,  it  should  exhibit  interactive  graphics  and 
simulation  facilities  that  increase  the  end  user’s  understanding  and  control  of  the  system 
being  represented.  The  system  being  developed  is  highly  user  Liendly  with  many  graphics- 
oriented  interface  features  such  as  interactive  graphics,  window  management,  explanation 
expansion  and  graphical  representation  of  knowledge  base  by  mapping  graphic  displays  to 

and  from  conclusions. 


Since  the  system  has  graphical  user  interface  with  explanatory  facilities,  little  or  no 
programming  knowledge  and  experience  is  required  to  conduct  an  inspection  of  tir«;oer 
Watren  trusses.  Users  simply  point  and  click  his/her  way  through  the  diagnosis  proces.s. 
Two  sample  consultations  with  the  system  regarding  the  inspection  of  truss  vertical 
members  and  purlins,  are  presented  in  the  following  sections. 


Fig.  3  illustrates  the  typical  screens  ((a)  to  (d))  during  a  consultation  session  with 
the  system.  The  member  under  consideration  is  the  vertical  member.  Graphical  display  of 
part  of  the  truss  with  locations  and  identifications  of  vertical  members  are  displayed  to 
assist  the  user  in  responding  to  the  question  as  shown  in  screen  (a). 

If  the  user  decides  to  want  to  know  more.about  one  or  more  particular  items  among 
the  given  checklist,  he/she  can  simply  click  the  Expand!  key  on  the  menu  bar  shoum  in 
screen  (a).  Clicking  the  Expand!  key  directs  the  user  to  the  ’help’  window  as  shown  in 
screoi  (b).  The  user  can  then  point  to  and  click  the  appropriate  object  button  in  screen  (b) 
to  activate  the  help  facility.  Screen  (c)  shows  additional  information  as  requested  by  the 
user  with  graphical  and  photo  image  displays  to  enhance  the  presenution  of  the  knowledge. 

Many  of  die  graphic  displays  in  tlie  system  illustrate  more  than  one  condition  of 
defects.  For  example,  screen  (c)  illustrates  three  different  types  of  defects,  namely, 
check/split  extending  to  edge  of  member,  split  passing  through  a  connector  and  split  in  the 
splice  blodc  expending  through  a  connector.  Screen  (c)  also  demonstrates  how  to  measure 
die  slope  of  grain.  Whenever  one  of  these  four  objects  were  activated  by  clicking  the  objea 
button  in  another  ’help’  window  similar  to  screen  (b),  screen  (c)  will  appear. 

Screen  (d)  is  the  conclusion  display.  In  this  case,  the  user  has  indicated  that  the 
member  has  "checks/splits  extending  to  the  edge  of  the  member".  Recommendation  from 
the  system  suggests  that  the  member  be  removed  and  replaced  with  deteils  of  the  remedial 
action  being  shown  on  the  same  display. 
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Fiio  CK!  Expand! 


tnspection  of  Warren  Truss 


vertical  member 


Please  select  the  conditions  that  most  . . 

adequately  describe  the  actual  condition  U3  U4  I 

of  the  vertical  member  :  yK  I . 

-  select  or  deselect  by  clicking  the  checkbox. 

-  you  may  select  more  than  one  condition;  ■  . . 

-  click  Expandl  for  additional  information:  L4 

•  click  OK!  after  selection  has  been  made. 

□  wrong  dimensions  /  V 

□  grain  slope  >  1/10  of  member  length  I  if 

□  mechanical  damage  >1/10  member  area 
O  member  decayed 

B  splits/checks  extened  to  edge  of  member 
O  end  split  (>0.5  mm)  extending  pass  the  truss  chord 

□  end  split  (>0.5  mm)  exposing  split  rings  from  under 

O  end  split  (>0.5  mm)  extending  through  a  gusset  connector 
O  end  split  {>3  mm) 


(a) 

_  Explanatory  information 

VERTICAL  MEMBER 

Click  the  appropriate  button  in  order  to  obtain  additional  information  : 
»  click  OK!  to  go  back 


Wrong  Dimensions 


Grain  Slope  Greater  Than 
One-Tenth  of  Member  Length 

Mechanical  Damage  Greater  Thar 
One-Tenth  of  Member  Area 


Member  Decayed 


End  Split  of  Greater  Than  0.5  mm 
Extending  Pass  the  Truss  Chord 

End  Split  of  Greater  Than  0.5  mm 
Exposing  Split  Ring  from  Under 

End  Split  of  Greater  Than  0.5  mm 
Through  a  Gusset  Connector 


End  Split  of  Greater  Than  3  mm 


Splits  or  Checks  Extended  to 
Edge  of  Member 


Fig.3  Screen  Displays  for  Vertical  Member 
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Explanatory  Information 


OK! 


1.  chacks/splits  extended  to  edge  of  member 

in  splice  block  passing  through  a  connector 
in  truss  member  passing  through  a  connector 
measuring  slope  of  grain 


K  1.  checks/spiii 
I  X  2.  split  in  splic 
L-i/  3.  split  in  trusi 
^  4.  method  of 


check  In  member 


main  axis  of  member 
slope  of  grain  *  V/H 


!  aV . ■ 

'f  j/  >4''  ■  ^  \  '""n 

<>J  . 


NOTE  ;  for  grain  slope,  disregard  local  grain  deviations  around  knots 


(c) 

ca| 

Conclusion 

1a 

OK! 

vertical  MEMBER 

Conditions  of  the  vertical  member  as  given  by  the  user  are  as  follows: 
-  splits/checks  extened  to  edge  of  member 


On  the  basis  of  this  information,  it  is  recommended  that  the  deficient  member 
be  removed  and  replaced  as  shown  below  : 

1 .  REMOVE  EXISTING  DAMAGED  MEMBER 

2.  IfJSTAU  NEW  GLULAM  DIAGONAL  OF 
THE  SAME  SIZE 

3.  DRILL  AND  DAP  TO  MATCH  EXISTING 
BOLT  AND  CONNECTOR  LOCATIONS 


(d) 


Fig.3  Screen  Displays  for  Vertical  Member  (com.) 
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Purlin 

Fig.  4  is  representative  of  typical  screens  ((a)  to  (d))  for  the  diagnosis  of  a  roof 
purlin.  To  assist  the  user  in  deciding  what  is  meant  by  flexural  failure,  a  photo  of  an  actual 
case,  screen  (c),  is  displayed  right  in  front  of  the  user  after  the  user  has  clicked  the 
Expand!  key  in  screen  (a)  and  the  appropriate  button  in  screen  (b). 

Screen  (d)  is  the  conclusion  display  suggesting  that  this  member  be  replaced.  Details 
of  tite  reinforcement  for  damaged  purlins  are  also  shown  on  the  same  display. 

Remarks 

At  the  end  of  each  session,  the  user  can  save  the  context  of  the  session  by 
appending  records  to  a  database  using  the  values  currently  in  the  context.  For  example, 
records  on  truss  vertical  member  can  be  appended  to  an  existing  database  file  which 
contains  the  history  of  problems  and  remedial  actions  on  all  vertical  members.  Since  the 
system  can  directly  communicate  with  existing  conventional  software  such  as  databases  and 
computational/analytical  programs,  the  user  can  examine  the  history  of  any  particular 
member  either  at  the  start  or  at  the  end  of  each  session. 


CONCLUSIONS 

Inspection  of  timber  Warren  trusses  requires  following  guidelines  and  applying 
heuristic  knowledge  such  as  experience  and  rules  of  thumb.  Because  of  the  nature  of  the 
inspection  process  and  all  the  heuristic  knowledge  that  is  associated  with  it,  Warren  truss 
inspection  was  found  to  be  a  good  application  of  expert  system  technology. 

The  proposed  system  combines  expert  system  technologies,  object-oriented 
programming,  relational  database  models  and  hypertext/graphics  in  a  windowing 
environment  Strategy  and  technique  used  in  the  development  of  the  system  were  presented 
and  discussed.  Two  sample  consultations  are  given  to  demonstrate  the  capabilities  of  the 
system. 
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Expandl 


inspection  of  Warren  Truss 


PURLIN 


Please  select  the  conditions  that  most 
adequately  describe  the  actual  condition 
of  the  purlin  : 

••  select  or  deselect  by  clicking  the  checkbox; 

-  you  may  select  more  than  one  condition; 

-  click  Expandl  for  additional  information; 

-  dick  OKI  after  selection  has  been  made. 

□  wrong  dimensions 

□  grain  slope  >  1/10  of  member  length 

O  mechanical  damage  >1/10  member  area 

□  member  decayed 
G9  flexural  failure 

□  ipiits/checks  extended  to  edge  of  member 


Explanatory  Information 


PURLIN 


Click  the  appropriate  button  in  order  to  obtain  additional  information  : 
-  dick  OKI  to  go  back _  ..  . 


Wrong  Dimensions 


Grain  Slope  Greater  Than 
One-Tenth  of  Member  Length 

Mechanical  Damage  Greater  Than 
One-Tenth  of  Member  Area 


Member  Decayed 


Splits  or  Checks  Extended  to 
Edge  of  Member 


Flexural  Failure 


Fig.4  Screen  Displays  for  Purlin 
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IS 


(d) 

Fig.4  Screen  Displays  for  Purlin  (cont.) 
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A  HEURISTIC  MULTIPLE  TARGET  TRACKER 
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y/^  Abstract 

Because  of  the  proximity  of  sensor  returns  during  crisis  situations  such  as 
crossing  tracks,  standard  multiple  target  tracking  algorithms  can  generate 
unreliable  target  state  estimates.  The  multiple  hypotheses  tracker  (MHT)  is  a  very 
powerful  algorithm  which  does  not  generate  a  single  track  for  each  target,  but 
rather  forms  hypotheses  composed  of  possible  tracks  and  associated  probability 
values.  The  hypotheses  bee  generated  can  bojome  quite  large,  and  by  extension, 
very  demanding  in  computer  resources.  Often,  the  probability  values  of  different 
hypotheses  are  close  and  deciding  on  which  set  of  compatible  hypotheses  to 
display  on  the  sensor  scope  is  difficult  to  make  until  additional  sensor  data 
becomes  available.  Notwithstanding  these  limitations  in  die  algorithm,  the  human 
operator  must  always  be  provided  with  timely  and  accurate  visual  information.  /' 
Considering  the  difference  between  the  behavioral  patterns  around  an  airport  in 
peace-time  and  the  aerobatics  around  a  ship  in  war-time,  we  argue  that  the 
characteristics  of  physical  targets  provide  useful  information  for  deciding  which 
hypotheses  are  the  most  likely.  Considering  the  effect  of  rain  on  the  performance 
of  sensors,  we  argue  that  the  environment  in  which  the  system  operates  also 
provides  knowledge  useful  to  tracking.  Similarly,  considering  the  effect  of  the 
density  of  targets  on  the  algorithm  itself,  we  argue  that  intrinsic  characteristics  of 
the  tracking  technique  provide  knowledge  useful  to  its  operation.  These 
/^knowledge  elements  have  been  formalized  as  heuristic  rules  operating  on  the 
'  hypotheses  tree  of  the  MHT.  In  effect,  the  MHT  algorithm  has  been  modified  to 
accept  contextual  and  intrinsic  knowledge  in  the  form  of  heuristic  rules,  ji 
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*Defence  Sckntis':,  Command  and  Control  Dividon,  DREV,  Vzlcsrtier 
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INTRODUCTION 

■  "ij 

Motivation 

Multiple  target  tracking  (MTT)  is  the  field  of  academic  research  which  applies  es- 

L 

timadon  theory  to  the  tracking  of  multiple  moving  targets  fi’om  sensor  returns.  Most 

SB'Sfi 

MTT  methods  are  algorithmic  and  can  thus  easily  be  implemented  on  digital  computers. 

Kii 

Many  of  the  simple  methods  have  long  been  implemented  in  working  systems.  Ever 

liili 

since  the  first  prototyj>e  of  the  Automated  Radar  Terminal  System  (ARTS)  was  installed 

ilsi 

in  Atlanta,  Georgia,  in  1964,  civilian  air  traffic  controllers  have  been  provided  with  esti- 

iiS® 

mates  of  the  kinematic  features  of  the  aircraft  within  their  surveillance  radar’s  field  of 

view  [12J.  In  recent  years,  the  processing  power  of  computers  has  greatly  inaeased. 

Unfortunately,  the  implementation  of  many  of  the  more  demanding  MTT  algorithms 

iii| 

into  working  systems  is  still  not  practical.  Recent  advances  in  software  development 

techniques  may  provide  the  required  environment  for  improving  the  performance  of 

Ss  .'■■■■'1 

these  algorithms.  Expert  systems  are  software  programs  which  perform  tasks  that  can- 

not  easily  be  broken  down  into  algorithms.  Through  this  research,  we  are  investigating  ■ 

if  ■'■  4 

the  potential  of  applying  recent  developments  in  ejq)ert  systems  to  MTT. 

Related  WbiIl 

A  literature  survey  to  review  the  goals,  successes  and  failures  of  p:ist  research  in 

applicable  domain  established  the  confines  of  the  research  topic  and  identified  the  dif¬ 

ferent  pertinent  study  areas  within  the  academic  context.  As  a  result  of  this  survey,  we 

have  situated  our  work  under  the  intersection  of  the  two  academic  fields  of  target  track-  ; 

ing,  and  expert  systems.  A  review  of  the  printed  literature  on  the  subject  has  revealed 

the  existence  of  a  limited  amount  of  research  in  this  area. 

I'M 

Single  Target  IVacking  (STT) 

STT  is  a  simplified  target  tracking  problem  whereby  the  kinematic  states  of  a 

-• ,  -  •  '■'"1 

single  target  are  estimated  from  noisy  and  cluttered  sensor  reports,  'fraditionally,  the 

estimated  track  is  obtained  by  building  a  linear  model  of  the  moving  target  and  filtering 

the  sensor  returns  through  a  standard  estimation  signal  processing  filter.  The  difficulty 
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with  STT  lies  with  the  formation  of  a  system  model  which  does  not  include  any  unknown 
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input  parameters  such  as  pilot  action.  The  literature  survey  revealed  a  single  attempt 
at  applying  expert  system  technology  to  STT.  Vanicola  [15]  proposes  that  an  expert  sys- 
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tem  can  be  used  for  sotting  out  and  selecting  the  best  track  amongst  a  set  of  different 
tracks  obtained  by  different  maneuvering  filters.  The  driving  knowledge  base  must  con¬ 
tain  the  knowledge  on  the  applicability  of  the  different  filters. 

Multiple  Target  Ikacking  (MTT) 

Most  research  falling  under  the  MTT  category  deals  with  data  association;  that 
is  process  of  matching  sensor  reports  with  tracks.  Depending  on  the  context  in  which 
a  physical  sensor  operates  and  the  characteristics  of  the  sensor  itself,  a  given  sensor  re¬ 
port  can  either  belong  to  a  tracked  target,  be  caused  by  a  new  target,  or  be  a  false  report 
caused  by  system  noise.  If  the  data  association  module  performs  its  function  properly, 
then  the  MTT  problem  simplifies  to  one  of  multiple  STT  systems  operating  in  parallel, 
’^ically,  data  association  pairs  are  formed  by  creating  a  volume  around  the  predicted 
position  of  an  existing  track  and  matching  sensor  reports  falling  within  this  volume  to 
the  track  in  question.  This  volume  is  referred  to  as  the  gate.  It  becomes  more  difficult 
to  deal  with  the  problem  when  more  than  one  return  falls  within  a  given  gate.  A  number 
of  MTT  algorithms  have  been  developed  to  deal  with  such  complex  situations.  Some 
of  the  more  popular  algorithms  will  be  discussed  in  the  second  section.  It  should  be 
noted  at  this  point,  though,  that  the  application  of  expert  system  technology  to  the  track¬ 
ing  of  multiple  targets  is  an  active  area  of  research. 

Morawdti  [10],  for  one,  advocates  the  use  of  heuristic  rules  for  tracking  a  closed 
set  of  known  moving  objects  which  cannot  easily  be  modelled  by  linear  systems.  An  ex¬ 
ample  of  these  objects  are  birds,  and  an  example  of  an  applicable  rule  is  that  “a  duck 
is  a  bird  that  normally  lands  on  water  and  never  perches  on  branches”.  In  this  applica¬ 
tion,  heuristic  rules  or  rules  of  thumb,  rather  than  gates,  are  used  for  matching  sensor 
reports  to  targets. 

Enhancement  to  more  traditional  solutions  to  the  MTT  problem  have  also  been 
prqwsed.  Kountzeris  [8],  as  an  example,  argues  that  an  expert  qrstem  could  be  built 
to  combine  and  take  advantage  of  the  features  of  two  MTT  algorithmic  methods.  He 
presses  that  the  simplicity  of  the  joint  probability  data  association  (JPDA)  method 
could  be  combined  with  the  adaptability  of  the  track  splitting  filter  (TSF)  using  a  knowl¬ 
edge  base  as  the  link.  Unfortunately,  the  reference  falls  short  of  discussing  the  imple¬ 
mentation  and  the  performance  of  the  composite  system.  Reiner’s  [14]  idea  goes  one 
step  ferther  than  Kountzeris.  Reiner  postulates  that  an  expert  system  could  manage  sev¬ 
eral  multiple  target  trackers  held  in  an  “algorithm  inventoiy”  and  deployed  by  heuristic 
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rules  which  would  select  an  algorithm  according  to  a  given  goal  function.  Again ,  this 
^tem  has  not  yet  been  implemented. 

A  third  possible  application  of  expert  systems  technology  to  MTT  is  one  docu¬ 
mented  by  Myler  [llj.  This  system  is  quite  unconventional  in  that  it  is  not  based  on  the 
estimation  theory,  but  rather  uses  advances  in  imaging  theory.  Thrget  tracks,  in  this  sys¬ 
tem,  are  obtained  by  matching  the  sensor  echos  to  pre-stored  fuzzy  tracks.  The  two 
modes  of  operation  of  this  system  include  one  for  learning  the  fuzzy  tracks  and  one  for 
normal  operation  once  the  fuzzy  tracks  have  been  learned. 

Other  researchers  in  this  domain  promote  the  use  of  an  cjqpert  system  for  control¬ 
ling  sensor  resources  such  as  output  power,  target  illumination  time  and  boresight  shape 
according  to  derived  situation  assessments  such  as  tracker  performance,  target  density 
and  electronic  countermeasures  (ECM).  [1,15] 

Multip. '  Sensor  Fusion  (MSF)  and  Higher  Inferences 

.  Another  popular  area  of  study  is  the  assistance  of  e.iq)ert  ^tems  to  problems  of 
MSF.  The  emphasis  of  such  applications  is  often  placed  on  track  correlation;  that  is, 
matching  of  tracks  obtained  from  individual  sensors  to  form  a  comprehensive  under¬ 
standing  of  the  environment  [4,6,8,9,14].  Higher  level  inferences  such  as  target  classifi¬ 
cation,  threat  assessment  and  weapons-to-target  assignment  are  often  proposed  as  ex¬ 
tensions  to  the  track  correlator.  MSF  and  higher  inferences  are  sometimes  grouped  in 
a  category  of  expert  system  problems  called  “Command  and  Control  (C^  problems 
[4,7,9.14,15]. 

Proposal 

We  propose  a  different  approach  for  applying  simple  expert  system  tools  to  the 
MTT  problem.  Reliability  is  of  prime  importance  during  cri.sis  situations  such  as  cross¬ 
ing  tracks,  but  because  of  the  time  and  space  proximity  of  the  sensor  reports,  standard 
multiple  target  tracking  algorithms  can  generate  relatively  unreliable  target  state  esti¬ 
mates.  The  multiple  hypotheses  tracker  (MHT)  is  a  veiy  powerful  algorithm  (and  de¬ 
manding  in  computer  resources)  which  can  handle  difficult  situations  by  differing  the 
formulation  of  hard  decisions.  It  does  not  generate  a  single  track  for  each  possible  tar¬ 
get,  but  rather  forms  hypothetical  tracks  with  associated  probability  (or  likelihood)  val¬ 
ues.  Often,  the  probability  values  of  different  hypotheses  are  close  and  the  decision  of 
which  set  of  compatible  hypotheses  to  display  on  the  sensor  scope  is  difficult  to  make 
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until  additional  sensor  data  becomes  available.  Notwithstanding  this  limitation  in  the 
algorithm,  the  human  operator  must  alvnays  be  provided  with  timely  accurate  visual  in¬ 
formation. 

a 

Heuristic  reasoning  is  a  problem  solving  methodology  associated  with  expert  sys¬ 
tems.  It  is  sometimes  applied  to  problems  which  cannot  easily  be  solved  using  an  algo¬ 
rithm.  <^plicabie  problems  usually  involve  missing  or  uncertain  information  and  are 
solved  by  traversing  a  decision  tree  using  a  heuristic  inference  (or  reasoning)  mechanism 
which  attempts  to  duplicate  the  reasoning  process  of  a  human  expert.  [3] 

We  believe  and  can  demonstrate  that  heuristics  can  be  formulated  to  improve  the 
performance  of  the  MHT.  These  rules  act  on  the  tracks,  hypotheses,  and  corresponding 
probability  values  to  decide  which  hypotheses  are  the  most  representative  of  reality. 
Some  of  the  rules  we  have  designed  assist  in  managing  the  hypotheses  tree  and,  by  exten¬ 
sion,  assist  in  managing  computer  resources.  We  have  also  been  successful  in  detecting 
and  following  the  possible  manoeuvre  of  a  target.  In  effect,  we  have  modified  the  MHT 
algorithm  to  accept  and  process  knowledge  of  the  context  (or  environment)  in  which  it 
<^rates  and  on  its  own  strengths  and  weakness. 

lb  evaluate  the  performance  of  our  concept,  we  have  built  a  prototype.  The  first  • 
step  in  building  this  prototype  was  deciding  on  the  context  in  which  our  multiple  target 
tracker  will  operate.  Because  we  wanted  to  keep  the  contextual  rules  as  simple  as  possi¬ 
ble  v^le  demonstrating  the  usefulness  of  a  working  heuristic  multiple  target  tracker, 
we  decided  to  simulate  the  airborne  environment  of  Canadian  Forces  Base  (CFB)  Por¬ 
tage,  a  small  military  flight  training  school  of  the  Prairies  as  viewed  through  the  returns 
of  a  modified  area  surveillance  radar  (ASR).  This  simulated  ASR  is  untypical  in  that 
it  provides  the  range,  azimuth  and  elevation  of  airborne  objects  while  a  typical  airfield 
ASR  only  provide  range  and  azimuth  information. 

QjiUiPg 

This  document  consists  of  three  sections.  Following  this  introduction,  the  second 
section  expands  on  the  academic  fields  of  concern  to  the  research.  It  describes  contem¬ 
porary  MTT  algorithms  and  discusses  their  strengths  and  weakness.  It  considers  current 
methods  of  programming  heuristic  reasoning  and  outlines  the  implementation  consider¬ 
ations.  It  also  outlines  the  theory  behind  the  MHT  and  proposes  our  concept  for  inte¬ 
grating  the  heuristic  knowledge  to  the  standard  MHT.  The  third  section  describes  our 
prototype  based  on  the  theory  described  in  the  previous  secticn  and  compares  the  per- 
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formance  of  our  heuristic  tracker  with  the  standard  MHT.  It  also  concludes  this  docu¬ 
ment  and  recommends  future  areas  of  research. 

BACKGROUND  THEORY 

Introduction 

The  theoretical  foundation  of  this  work  was  obtained  by  studying  recent  published 

work  in  three  areas.  First,  contemporary  MTT  methods  were  studied  in  order  to  under¬ 
stand  the  strengths  and  weakness  of  the  different  techniques  and  to  choose  the  technique 
showing  the  most  potential  of  integration  with  heuristic  reasoning.  Secondly,  publica¬ 
tions  on  the  application  of  expert  system  tools  to  problems  similar  to  MTT  were  re¬ 
viewed.  Lastly,  to  ensure  the  accuracy  of  the  prototype  Simulator;  information  on  the 
characteristics  of  small  aircraft  in  flight  was  gathered,  the  applicable  chararteristics 
of  ASRs  were  studied,  the  air  traffic  control  (ATC)  procedures  were  reviewed,  and  the 
features  of  visual  and  automated  ATC  support  equipment  were  considered. 

Before  we  can  move  on  to  discuss  different  techniques  for  following  multiple  mov¬ 
ing  targets  from  sensor  reports,  we  must  first  get  acquainted  with  estimation  theory  as 
it  applies  to  the  tracking  of  a  single  target. 


Figure  1  illustrates  a  simple  estimation  filter.  It  accepts  noisy  signals  as  its  input 
and  produces  “clean”  signals  for  the  output.  In  a  target  tracking  application,  the  noisy 
signals  are  the  measured  states  of  a  target  and  the  “clean”  signals  are  its  estimated  states. 
Estimates  for  all  of  the  target  states  can  be  produced  provided  the  measured  signals 
form  an  observable  set  of  the  target  states.  As  an  example;  assuming  that  the  range, 
azimuth  and  elevation  measurements  of  a  target  are  given  and  that  the  target  moves  with 
a  constant  velocity,  then  not  only  can  we  estimate  the  three  dimensional  location  of  the 

target,  but  we  can  also  estimate  its  three  dimensional  speed  and  heading. 

A  target  tracking  filter  will  thus  accept  sensor  measurements  of  a  target  and  will 
estimate  the  kinematic  features,  or  the  track,  of  the  target  which  caused  these  measure¬ 
ments.  The  filtering  process  normally  entails  simplifying  assumptions  to  reduce  the 
computational  burden  and  to  contend  with  the  ^tern’s  limited  knowledge  on  the 
tracked  object.  In  particular,  a  tracking  filter  estimating  the  states  of  an  aircraft  cannot 
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Figure  1  •  Simple  Estimation  Filter 

easily  be  provided  with  knowledge  on  the  actions  of  the  pilot.  A  common  simplifying 
assumption  made  is  that  the  moving  object  can  be  modelled  by  a  set  of  linear  constant 
coefficient  ordinary  n***  order  differential  equations.  Most  often,  for  computational  rea¬ 
sons,  "n”  seldom  exceeds  two  and  is  normally  limited  to  one. 

The  Kalman  filter  is  such  a  linear  filter.  It  also  has  the  important  quality  of  being 
recursive  so  that  a  history  of  past  measurements  doe.,  not  have  to  be  maintained.  The 
popularity  of  this  filter  is  founded  on  the  fact  that  it  is  an  optimal  recursive  filter  that 
will  perform  as  well  as  can  be  expected  of  any  other  recursive  filter  as  long  as  the  physical 
target  behaves  according  to  the  assumed  model.  In  other  words,  given  a  first  order  mod¬ 
el,  the  Kalman  filterwill  behave  optimally  unless  the  target  accelerates  (or  manoeuvres). 

Multiple  Target '^addiig 

Earlier  we  mention  tiiat  most  research  work  in  MTT  is  directed  toward  data  asso¬ 
ciation.  Data  associatiorM  in  the  single  sensor  context,  can  be  defined  as  the  process  of 
charaaerizing  a  given  sensor  report  as  either  belonging  to  a  known  target,  to  a  previous¬ 
ly  untracked  target,  or  to  a  false  alarm.  Throughout  this  document  sensor  reports  which 
do  not  correspond  to  any  physical  targets  are  called  false  alarms  (FA). 

Basically,  three  popular  MTT  techniques  have  been  developed.  The  earliest  and 
easiest  to  implment  is  the  nearest-neighbor  (NN)  algorithm.  The  NN  assumes  that 
the  best  correlation  is  the  one  that  associates  tracks  and  reports  that  are  closest,  in  some 
statistical  sense.  This  algorithm,  however,  undergoes  severe  performance  degradation 
as  target  and  false  alarm  densities  reach  moderate  levels.  It  forces  an  association  which 
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in  many  cases  is  erroneous,  and  has  no  formalized  capability  to  account  for  the  fact  that 
a  target  is  not  always  detected. 

The  second  technique  we  discuss  is  the  Joint  Probabilistic  Data  Association  Filter 
(JPDAF)  [2],  In  this  algorithm,  all  of  the  reports  reasonably  close  to  a  given  track  are 
used  to  form  a  weighted  average  and  the  result  is  used  to  update  the  track.  The  weights 
are  based  on  the  probability  that  the  report  originated  from  the  target  and  is  a  function 
of  statistical  distance.  This  algorithm  has  several  drawbacks.  While  it  shows  the  ability 
to  maintain  continuity  superior  to  the  nearest-neighbor  algorithm,  it  does  this  at  the 
expense  of  accuracy.  This  is  apparent  since  all  reports  are  used  in  computing  the  track 
update  even  though  at  most  one  report  is  really  from  the  target.  The  others  must  be 
reports  from  other  targets  or  from  false  alarms.  Another  limitation  to  both  of  these 
techniques  is  that  track  initiation  and  track  termination  are  not  inherent  to  the  algo¬ 
rithms,  but  must  be  handled  separately. 

The  third  and  last  candidate  MTT  technique  is  the  Multiple  Hypothesis  Ti’acker 
(MHT)  [2,13].  Here,  instead  of  trying  to  resolve  a  difficult  association  immediately,  all 
possibilities  are  enumerated  as  hypotheses.  The  probability  of  each  hypothesis  is  com¬ 
puted,  and  ideally,  all  hypotheses  are  maintained  until  there  is  enough  data  to  make  a 
decision  as  to  the  correct  hypothesis.  Since  it  would  be  extremely  computationally  de¬ 
manding  to  maintain  all  hypotheses,  a  suboptimal  implementation  which  includes  a 
medianism  for  pruning  unlikely  hypothesis  must  be  used.  This  algorithm  contains  a 
number  of  advantages  over  the  other  two  technique?  Some  of  these  advantages  are  that 
track  initiation  is  an  integral  part  of  the  algorithm,  the  manoeuvre  detection  can  be  han¬ 
dled  within  the  basic  algorithm,  and  last  but  not  least,  one  of  the  hypotheses  must  be 
the  correct  one. 

A  useful  concept  for  MTT  is  that  of  gating  [2].  Gates,  or  correlation  gates,  are 
sets  of  positional  and  velocity  limits  in  each  coordinate.  Asensor  report  which  falls  with¬ 
in  the  gate  of  a  track  is  said  to  correlate  with  that  track.  It  should  be  noted  that  all  of 
the  three  techniques  of  MTT  described  above  support  gating,  but  they  can  also  be  im¬ 
plemented  without  it. 

For  illustrative  purposes,  we  will  now  consider  a  simple  data  association  problem 
and  discuss  the  process  followed  by  each  of  the  three  algorithms  introduced  above.  The 
situation  considered  is  shown  in  figure  2.  Our  system,  which  uses  gating,  has  been  track¬ 
ing  targets  for  some  time.  TWo  tracks,  T1  and  T2,  are  being  followed.  We  now  stand 
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at  the  k***  sample  (k  is  a  positive  integer).  A  gate  is  formed  around  each  of  the  two  tracks 
and  is  drawn  as  an  oval  centered  on  the  predicted  positions  (Tlkin  and  T2ic|ic.i)  for  sam¬ 
ple  k  given  the  measurements  up  to  sample  (k-1) .  Three  measureme  its  (or  reports), 
M*.  Mb  and  fall  within  the  boundaries  of  either  of  the  two  gates.  All  three  measure¬ 
ments  fall  within  the  gate  of  T1  while  only  M*  and  Mb  correlate  with  T2.  A  fourth  mea¬ 
surement,  M<j,  does  not  correlate  with  any  of  the  two  tracks . 


Figure  2  -  Data  Association  Problem 


Let  us  define  the  residue  to  be  the  distance  between  the  predicted  position  of  a 
track  and  the  locanon  of  a  given  sencor  report.  The  first  algorithm,  the  NN,  processes 
T1  by  calculating  the  residue  between  the  position  labeled  Tlkin  and  the  locations  of 
M„  Mb  and  Me  and  uses  the  closest  measurement  to  update  the  track.  Similarly,  for 
T2,  it  uses  either  M,  and  Mb  depending  on  which  one  is  closest  to  the  location  labeled 
T2k|k-i.  Notice  that  no  constraints,  within  the  standard  algorithm,  prevents  M,  from 
updating  both  tracks.  Also,  the  basic  algorithm,  implemented  without  gating,  cannot 
deal  directly  with  missed  reports,  that  is  physical  targets  which  are  not  reported  by  the 
sensor.  There  exist  variances  to  this  algorithm,  one  of  rhese  being  the  Tl-ack  Splitting 
Filter  (TSF)  which  attempts  to  deal  with  the  problem  of  multiple  measurements  falling 
within  a  gate. 

The  next  technique  we  introduced  is  the  JPDAF.  Again,  as  with  the  NN,  the  resi¬ 
dues  between  compatible  tracks  and  measurements  are  computed.  To  update  track  Tl, 
a  hypothetical  measurement  is  formed  by  calculating  a  weighted  average  of  residues  be¬ 
tween  Tl  and  each  of  the  three  measurements  falling  within  its  gate.  The  weights  used 
are  based  on  the  residues  themselves.  The  smaller  the  residue,  the  higher  the  weight. 
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TVack  T2  is  also  updated  through  the  same  process  using  M,  and  Mb-  As  mentioned 
earlier,  the  JPDAF  is  not  as  accurate  as  the  NN.  It  disregards  the  undebatable  premise 
that  at  most  one  measurement  a  scan  is  caused  by  physical  target.  On  the  other  hand, 
it  is  more  capable  of  maintaining  continuity  since  its  performance  will  suffer  less  than 
the  NN  whenever  the  wrong  measurement  happens  to  be  closest  to  a  predicted  target 
n. 


Figure  3  -  Hypotheses  Generation  in  MHT 


Consider  again  our  example.  Figure  3  shows  part  of  the  hypotheses  tree  that 
would  be  generated  by  the  MHT.  Suppose  an  earlier  hypothesis  at  scan  k-1,  identified 
in  the  figure  as  Hi(k-1),  included  the  existence  of  the  two  tracks  T1  and  T2.  Because 
Ma  correlates  with  both  tracks,  four  child  hypotheses  are  created  from  Hi(k-l).  The  first 
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(Hj(k))  assigns  M,  to  Tl;  the  second  (H2(k))  matches  it  to  T2;  the  third  hypotheses 
(H3(k))  labels  M,  as  being  a  false  alarm  (FA);  while  the  last  one  (HtCk))  assigns  it  to 
a  new  target  it  calls  T3.  Now,  Mj,  also  falls  within  the  gate  of  both  targets.  Each  of  the 
four  new  hypotheses  formed  by  processing  M,  generate  additional  hypotheses  when  Mb 
is  processed.  Given  that  M,  was  assigned  to  Tl  (Hi(k)).  three  new  hypotheses.  HsCk) 
through  H7(k).  are  generated.  Note  that  Mb  cannot  be  assigned  to  Tl  since  Tl  has  al¬ 
ready  been  updated  under  its  parent  hypotheses.  Mb.  on  the  other  hand,  can  still  be  used 
to  update  T2  (H5(k)).  It  could  also  have  been  caused  by  system  noise  (H6(k))  or  it  could 
indicate  the  existence  of  a  new  target  called  T4  (HtOc)).  On  the  other  hand,  assuming 
H2(k)  to  be  right,  three  new  hypotheses  are  formed  and  join  the  tree  under  H2(k).  Simi¬ 
larly,  four  new  hypotheses  are  generated  under  each  of  H3(k)  ard  H4(k).  In  effect  after 
processing  two  measurements  of  scan  k,  our  initial  hypotheses  Hi(k-l)  gave  birth  to  14 
child  hypotheses.  After  processing  the  third  measurement  (Me)  in  a  similar  manner,  the 
number  of  hypotheses  increases  to  36.  For  lack  of  space,  figure  3  does  not  show  the 
new  leafs  created  by  processing  Mj.  Because  M<j  does  not  correlate  with  any  existing 
track,  only  two  hypotheses  are  generated  under  each  of  the  hypotheses  formed  by  pro¬ 
cessing  Me-  The  first  one  characterizes  Md  as  a  new  target  (Tb)  while  the  second  one 
makes  it  a  false  alarm.  The  number  of  end  hypotheses,  thus,  doubles  to  72.  It  should 
also  be  noted  that  the  algorithm  provides  means  for  calculating  the  probability  (or  likeli¬ 
hood)  of  each  hypothesis.  This  probability  value  is  a  function  of  the  probability  of  its 
parent,  the  expected  density  of  real  targets,  the  expected  density  of  false  alarms,  the  ex¬ 
pected  probability  of  detection,  the  residue  as  defined  earlier,  the  expected  quality  of 
the  tracks  (track  covariance  matrix)  and  the  expected  precision  of  the  measurements 
(measurement  covariance  matrix). 

The  fundamental  difference  between  the  MHT  and  the  other  two  algorithms  de¬ 
scribed  above  is  that  it  is  measurement  oriented  rather  than  being  track  oriented.  TVack 
oriented  algorithms  require  prior  knowledge  of  the  existence  of  targets  before  they  can 
form  estimates  of  kinematic  features.  They  form  track  to  measurement  associations  ac¬ 
cording  to  the  probability  that  a  given  measurement  belongs  to  a  known  track.  Such 
techniques,  i.e.  the  JPDAF  and  the  NN,  do  not  formally  provide  means  of  recognizing 
the  existence  of  a  new  target  or  the  termination  of  a  vanished  target.  Measurement  ori¬ 
ented  techniques,  such  as  the  MHT,  use  the  prior  knowledge  that  we  have  a  report,  and 
compute  the  probability  that  this  report  belongs  to  an  existing  target,  to  a  new  target, 
or  is  caused  by  a  false  alarm.  Clearly,  techniques  based  on  the  track  oriented  model 
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are  more  manageable  since  the  measurement  oriented  model  involves  excessive  growth 
of  hypotheses  that  must  be  stored  and  manipulated. 

Nevertheless,  with  the  computation  power  of  present  day  digital  computers,  and 
using  some  simplifying  assumptions  based  on  the  environment  (or  context)  on  which  the 
MTT  operates,  an  MITf  can  be  fine  tuned  to  perform  adequately.  Knowledge  engineers 
find  the  algorithm  quite  attractive  in  that  it  generates  a  multitude  of  mutually  exclusive 
interpretations.  The  challenge  resides  in  choosing  the  most  likely  interpretations  to  be 
di^layed  to  the  human  operator.  Also,  unlikely  interpretations  can  be  removed  from 
the  hypotheses  tree  to  limit  its  growth  and  maintain  the  computer  resources  requirement 
within  manageable  limits.  Again,  the  problem  is  in  establishing  which  interpretations 
are  unlikely. 


E}q)ert  ^tems,  in  this  document,  are  systems  which  attempt  to  model  the  heuris¬ 
tics  or  rules  by  which  human  experts  solve  problems.  Human  experts  can  reason  with 
incomplete,  uncertain  and  contradictory  knowledge.  Human  faces  are  all  different,  but 
a  baby  girl  easily  recognizes  her  inother’s  face  very  early  in  life  even  though  she  has  as¬ 
similated  and  can  understand  few  facts  about  her  environment.  In  effect,  this  child  is 
an  expert  at  recognizing  human  faces.  In  fact,  she  is  probably  more  efficient  In  this  role 
than  any  of  the  contemporary  artificial  systems.  Human  experts  commonly  apply  their 
knowledge  heuristically.  They  explaiti  their  decision  making  process  by  using  analogies, 
examples,  guesses,  or  rules  that  apply  within  restrictive  conditions.  Attempts  to  auto¬ 
mate  such  decision  making  processes  often  perform  poorly  because  of  the  difficulty  in 
formalizing  all  of  the  necessary  rules.  This  problem  is  being  looked  into  by  researchers 
in  the  field  of  knowledge  acquisition. 

Let  us  consider  three  classes  of  problem  solving  methodologies  and  define  a  two 
dimensional  space  we  call  the  solution  space.  Within  this  space,  a  problem  solving  meth¬ 
odology  is  described  as  a  search  tree.  The  root  represents  the  initial  states  of  the  prob¬ 
lem,  branches  describe  applicable  interim  solutions  and  the  end  nodes  characterize  pos¬ 
sible  complete  solutions  to  the  problem.  Figure  4  illustrates  the  three  classes  we  will 
describe. 

The  first  class,  figure  4(a)  the  exhaustive  search,  is  one  where  all  of  the  possible 
solutions  are  investigated.  The  tree  is  traversed  either  in  a  depth  first  or  a  breath  first 
manner  and  admissible  branches  are  never  disregarded.  Comparing  figures  3  and  4(a), 
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Figure  4  -  Searching  for  a  Solution 


we  quickly  realize  that  the  MHT,  without  pruning,  falls  within  this  category.  An  impor¬ 
tant  consideration  in  implementing  such  problem  solving  methods  is  that  decisions  are 
never  firm,  but  are  continuously  reviewed,  A  problem  with  this  technique  is  that  it  pro¬ 
vides  a  variety  of  possible  solutions,  but  no  way  of  distinguishing  which  solutions  are 
right  or  the  best. 

The  second  class,  illustrated  in  figure  4(b),  includes  techniques,  such  as  the  NN 
and  the  JPDA,  where  hard  decisions  are  formed  at  every  level  of  the  tree  so  that,  once 
the  decision  is  formalized,  it  can  never  be  reviewed.  We  refer  to  this  problem  solving 
methodology  as  monotonic  reasoning  with  reference  to  the  impossibiliqr  to  review  deci¬ 
sions  made  earlier  in  dme. 

In  some  ways,  the  third  and  last  class,  shown  in  figure  4(c),  is  a  compromise  be¬ 
tween  the  other  two.  The  intent  is  to  improve  the  manageability  of  the  exhaustive  search 
by  eliminating  unlikely,  but  admissible,  solutions.  Hard  decisions,  similar  to  the  ones 
made  in  monotonic  reasoning,  are  made  to  distinguish  between  likely  and  unlikely 
nodes.  Nodes  labelled  as  unlikely  are  removed  (or  pruned  out)  from  die  decision  tree. 
Soft  decisions  are  also  continuously  reviewed  to  establish  which  of  the  possible  end  solu- 
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tions  are  good  and  worth  returning  to  the  human  operator  (or  to  other  systems).  These 
decisions  are  guided  by  the  amount  of  computer  resources  available,  the  timeliness  re* 
quirenients  of  the  solution,  and  the  acceptable  error  or  impreciseness  rate.  The  condi¬ 
tions  (or  rules)  on  which  these  decisions  are  based  are  determined  by  the  environment 
in  which  the  system  operates  and  on  the  intrinsic  characteristics  of  the  algorithm.  These 
conditions  arc  also  often  subjective  and  formed  by  the  designer  according  to  his  ratio¬ 
nalization  of  the  environment  and  his  comprehension  of  the  algorithm.  It  is  the  subjec¬ 
tive  nature  of  these  conditions  that  characterizes  this  reasoning  class,  which  we  call  heu¬ 
ristic  reasoning. 

We  have  been  introduced  earlier  to  the  problem  of  potentially  unmanageable  (NP 
hard)  growth  of  the  MHT  hypotheses  tree.  Obviously,  the  MHT  cannot  be  implemented 
directly  as  an  exhaustive  search  problem.  Not  only  would  the  computer  resources  quick¬ 
ly  extend  above  manageable  limits,  but  io  many  possible  solutions  would  exist  that  it 
would  be  impossible  to  find  the  correct  one.  Unlikely  hypotheses  must,  then,  be  pruned 
out  to  keep  the  problem  manageable  (NP  complete).  A  method  for  confirming  good 
hypotheses  must  also  be  put  into  place  to  provide  the  means  of  returning  the  human 
operator  with  the  system’s  best  interpretations  of  the  sensor’s  environment.  These 
changes  to  the  standard  MHT  would  make  it  fall  in  the  heuristic  class  of  algorithms. 

The  difficulty  now  lies  in  establishing  the  criteria  to  use  in  characterizing  hypothe¬ 
ses  as  good,  likely  or  unlikely.  Obviously,  the  easiest  method  to  distinguish  unlikely  hy¬ 
potheses  from  the  others  is  to  use  their  probability  values.  We  can  either  remove  the 
hypotheses  that  fall  under  a  probability  threshold  or  keep  the  n  (n  is  a  positive  integer) 
most  probable  ones.  Good  hypotheses  can  also  be  defined  as  the  ones  of  highest  proba¬ 
bility.  Chen  [5]  proposes  an  effident  method  of  implementing  such  a  selection  tech¬ 
nique  based  on  the  branch-and-bound  algorithm.  Using  his  technique,  the  computer 
would  find  the  good  and  likely  hypotheses  without  formally  forming  them.  Unlikely  hy¬ 
potheses  would  then  never  be  created.  Another  advantage  of  the  branch-and-bound 
algorithm  is  that  the  selection  process  could  be  implemented  on  a  multiprocessor  sys¬ 
tem. 

The  problem  with  this  technique  is  that  the  probability  value  of  hypotheses  is 
based  on  features  which  are  assumed  and  may  not  be  representative  of  reality.  As  an 
example,  as  weather  changes,  the  density  of  false  alarms  is  normally  affected;  but  the 
manner  in  which  it  is  affected  is  unpredictable.  As  a  result,  the  expected  density  of  false 
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alarm  is  never  well  known,  but  this  value  is  necessaiy  for  the  computation  of  the  proba¬ 
bility  of  every  hypothesis  which  includes  the  supposed  existence  of  a  false  target.  Our 
attempt  is  to  find  heuristic  ways  of  characterizing  hypotheses  using  the  knowledge  of 
the  environment  in  which  the  sensor  operates,  the  knowledge  of  the  characteristics  of 
the  targets  normally  found  in  view  of  the  sensor  and  the  knowledge  of  the  intrinsic  char¬ 
acteristics  of  the  algorithm. 

THE  HEURISTIC  MTT  PROTOTYPE 

Introductifin 

Figure  5  shows  the  block  diagram  of  the  heuristic  based  MTT  built  to  investigate 
the  viability  of  our  concept.  The  MTT  itself  is  depicted  by  the  center  block  in  the  figure. 
It  is  composed  of  two  sub-modules.  The  first  sub-module  is  a  standard  MHT  while  the 
second  formalizes  the  concepts  described  in  the  last  section.  We  have  also  designed  a 
scenario  generator  which  allows  us  to  build  suitable  flight  trajectories  and  set  up  scenar¬ 
ios  by  combining  different  trajectories  in  time  and  space.  These  scenarios  are  then  used 
by  the  sensor  data  generation  module  which  generates  simulated  sensor  reports  which 
are  then  forwarded  to  our  tracker.  Our  last  module  is  our  graphical  display  module 
which  accepts  the  system’s  best  interpretation  of  reality  and  displays  the  corresponding 
tracks.  Many  of  the  heuristic  features  of  our  system  can  easily  be  removed  so  that  we 
can  compare  their  effect  on  the  performance  of  the  overall  ^tem. 

Physical  Environment  of  the  Protolm 

The  immediate  airspace  around  an  airport  is  strictly  regulated.  To  maintain  air 
traffic  separation,  pilots  can  either  use  the  services  of  air  traffic  controllers  or  obey  visu¬ 
al  flight  regulations  (VFR).  The  choice  between  these  two  alternatives  depends  on  the 
intentions  of  the  pilot  and  on  the  weather.  As  an  example,  to  land  or  take-off,  pilots 
must  always  contact  the  controllers.  They  may  not  need  any  clearance,  though,  if  they 
are  already  airborne  and  simply  wish  to  fly  through  controlled  airspace  without  interfer¬ 
ing  with  other  traffic.  In  either  event,  there  exist  strict  guidelines  for  vertical  and  hori¬ 
zontal  separation  between  traffic,  restrictions  on  the  altitude  of  flight  depending  on 
heading,  and  formalized  standard  flight  behavior  patterns  which  reveal  much  about  the 
intention  of  the  pilot.  As  a  result  of  these  regulations,  the  behavior  of  targets  within 
the  airspace  of  an  airport  under  normal  circumstances,  is  somewhat  predictable  [12]. 
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Figure  5  -  Heuristic  Multiple  Target  Tracker 
Knouiedge  based  on  the  predictable  features  of  targets  can  assist  in  forming  some  of 

the  heuristic  rules  necessary  in  improving  the  manageability  of  the  MHT. 

The  type  of  traffic  around  a  given  airport  also  tends  to  be  predictable.  As  a  test 
location,  we  have  studied  the  airborne  environment  of  a  small  military  training  airport 
of  the  Canadian  prairies  called  CFB  Portage.  Veiy  rarely  does  any  traffic  other  than 
the  training  aircraft  venture  within  the  controlled  airspace  of  Portage.  Accordingly, 
characteristics  of  ei^ected  targets  such  as  cruising  speed,  climb  and  descent  rates,  and 
maneuverability  can  be  used  to  form  restrictions  on  the  characteristic  of  the  tracked  tar¬ 
gets.  In  turn,  these  restrictions  may  assist  in  characterizing  hypotheses  as  good,  likely 
or  unlikely. 

We  have  developed  different  scenarios  to  test  our  prototype.  Our  principle  sce¬ 
nario  lasts  25  minutes  and  includes  up  to  nine  targets  of  various  kinds  performing  aero¬ 
batics  typical  to  the  Portage  airspace.  Seven  of  these  targets  (three  Tbtor  jets,  three 
Musketeer  propellor  planes  and  one  Jet  Ranger  helicopter)  are  common  to  the  Portage 
environment,  the  eighth  one  is  a  707  flying  through  the  scan  volume  of  our  sensor  at 
a  high  altitude,  and  our  last  aircraft  is  a  civilian  Cessna  150  which  has  similar  flight  char¬ 
acteristics  to  the  military  propellor  trainer,  the  Musketeer. 

The  sensor,  its  location  and  its  characteristics  can  also  play  a  role  in  forming  the 
heuristic  rules.  If  a  radar  is  located  in  such  a  way  that  the  ATC  tower  shadows  targets 
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behind  it,  the  probability  of  receiving  an  echo  from  this  shadow  is  low.  The  knowledge 
such  as  this  can  be  of  assistance  to  the  MTT.  Similarly,  weather  and  other  environmental 
elements  (such  as  sea  clutter)  is  known  to  affect  the  performance  of  sensors.  The  effect 
of  these  elements,  we  believe,  should  also  be  integrated  in  a  working  system. 

Our  prototype  uses  a  simple  model  for  the  sensor.  It  simulates  a  modified  Area 
Surveillance  Radar  (ASR)  with  a  scan  range  of  40  km  and  a  azimuth  range  of 360°.  The 
ASR  of  a  typical  airfield  provides  range  and  azimuth  information  of  aircraft  within  its 
field  view  but  our  simulated  sensor  also  returns  elevation  information.  In  fact,  our  simu¬ 
lated  sensor  has  an  elevation  range  of  0®  to  60®.  We  justify  this  inconsistent^  between 
our  simulated  sensor  and  physical  tystems  by  noting  that  the  tracking  algorii'hm  of  most 
working  systems  use  the  altitude  provided  by  the  Secondary  Surveillance  Radar  (SSR) 
transponder  of  physical  aircraft  and  are  thus  able  to  perform  three  dimensional  tracking. 
Because  we  initially  restricted  the  scope  of  our  work  to  the  single  sensor  case,  we  felt 
our  approach  of  simulating  a  three  dimensional  ASR  reasonable. 


Because  of  the  responsibility  resting  on  the  shoulders  of  air  traffic  controllers, 
their  support  tools  must  be  extremely  dependable.  Accuracy,  timeliness,  and  complete¬ 
ness  of  information  is  crucial. 

We  have  thus  chosen  to  display  a  large  number  of  tracks.  Fortunately,  because 
most  of  the  tracks  are  concentrated  around  the  location  of  physical  targets  and  many 
are  so  close  that  they  overlap,  we  found  that  this  practice  did  not  overly  clutter  the  opera¬ 
tor  scope.  Another  heuristic  Is  that  the  association  of  a  measurement  to  an  existing  tar¬ 
get  or  to  a  new  target  is  always  favored  over  the  characterization  of  this  measurement 
as  a  false  alarms.  This  has  improved  the  timeliness  of  the  algorithm  while  rendering  the 
algorithm  more  conservative  in  its  measurement  to  track  correlation. 

We  have  also  been  successful  in  using  target  related  features  in  forming  heuristic 
rules.  Tracks  which  are  too  high  to  belong  to  any  e;q)ected  physical  targets  are  weeded 
out.  We  also  reduce  the  number  of  possible  correlations  by  preventing  gates  from  hav¬ 
ing  radii  larger  than  the  distance  that  can  be  travelled  by  targets  fl>ing  at  a  multiple  (be¬ 
tween  two  and  three)  of  the  maximum  speed  of  aircraft  e)5)ected  within  the  surveillance 
volume.  Because  new  tracks  have  high  covariance,  the  correlation  gate  formed  in  the 
classical  manner  around  a  new  track  is  quite  large.  This  reduction  in  gate  size  has  im¬ 
proved  the  timeliness  of  the  tystem  wi  thout  affecting  the  accuracy.  Another  use  for  these 


expected  maximum  speed  parameters  is  in  initializing  the  velocity  elements  of  the  track 
covariance  matrix. 

Unfortunately,  because  the  versatility  of  our  sensor  model  is  limited,  our  proto¬ 
type  does  not  allow  us  to  observe  the  effect  heuristics  on  changing  environmental  fea¬ 
tures.  In  our  sensor  model,  the  probability  of  detection  of  physical  targets  is  kept  con¬ 
stant  and  is  independent  of  the  range  and  the  radar  cross  section  of  individual  targets. 
Also,  the  density  of  false  alarms  and  the  standard  deviation  of  measured  positions  are 
constant  in  time  and  ^ace.  These  parameters  must  be  set  before  running  the  sensor 
module  and  cannot  be  changed  as  the  scenario  unfolds.  Accordingly,  heuristic  rules 
based  on  changing  environmental  features  (such  as  weather  and  shadowed  targets  which 
affect  these  parameters)  cannot  be  tested  with  our  present  prototype.  We  have  been 
successful,  though,  in  projecting  the  tracks  of  non-maneuvering  targets  leaving  the  sur¬ 
veillance  volume  (elevation  above  60®)  and  in  resuming  normal  tracking  as  they  re-enter 
the  viewed  space. 

The  changes  mentioned  above  are  minor,  but  have  revealed  themselves  to  be  ef¬ 
fective  in  the  air  traffic  control  environment.  Because  of  the  regulations  that  targets 
follow  in  such  an  eavironment,  they  are  normally  well  behaved  and,  thus,  easy  to  track. 
Our  main  scenario  of  25  minutes  (300  scans)  involves  nine  targets  behaving  within  regu¬ 
lated  directives.  We  have  been  successful  in  displaying  timely,  accurate,  and  dependable 
information.  The  tracking  module  of  our  system  normally  returns  the  estimated  inter¬ 
pretation  of  reality  within  three  second  of  processing  time,  it  very  seldom  looses  track 
of  a  target  even  if  the  target  is  maneuvering,  it  displays  all  new  physical  targets  within 
four  scan  periods  and  it  seldom  shows  false  targets.  We  have  also  been  successful  in 
associating  tracks  belonging  to  the  same  target  and  are  now  in  the  process  of  developing 
heuristics  for  situation  assessment.  The  situation  assessment  module  will  be  responsible 
for  finding  tracks  belonging  to  physical  targets  that  do  not  comply  with  the  behavior  ex¬ 
pected  of  them.  Examples  of  such  unauthorized  behavior  are:  aircraft  flying  too  low, 
aircraft  with  conflicting  headings,  and  unauthorized  separation  between  two  aircraft. 
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